Sep 15 13:38:43.056682 ip-10-0-134-169 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 13:38:43.484179 ip-10-0-134-169 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:43.484179 ip-10-0-134-169 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 13:38:43.484179 ip-10-0-134-169 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:43.484179 ip-10-0-134-169 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 13:38:43.484179 ip-10-0-134-169 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 13:38:43.485368 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.485252    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 13:38:43.490449 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490429    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.490449 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490449    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490453    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490457    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490459    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490462    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490466    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490471    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490474    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490477    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490479    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490484    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490487    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490490    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490493    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490496    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490499    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490502    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490504    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490507    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.490526 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490510    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490512    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490515    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490518    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490521    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490530    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490534    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490538    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490541    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490544    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490546    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490549    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490552    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490554    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490557    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490559    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490562    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490564    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490567    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.490983 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490569    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490572    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490574    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490577    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490580    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490582    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490584    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490587    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490589    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490592    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490594    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490597    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490599    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490602    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490604    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490608    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490612    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490615    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490617    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490620    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.491468 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490623    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490625    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490627    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490630    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490633    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490635    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490639    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490641    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490644    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490647    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490649    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490652    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490654    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490657    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490659    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490662    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490664    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490667    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490669    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490672    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.491957 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490674    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490678    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490681    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490684    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490686    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490689    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490691    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490695    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490698    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490701    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490704    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490707    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490709    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490712    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490715    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490718    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490720    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490723    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490725    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.492462 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.490728    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492520    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492528    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492532    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492535    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492538    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492541    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492545    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492548    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492551    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492553    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492556    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492559    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492561    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492564    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492569    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492572    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492574    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492577    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492580    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.492927 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492583    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492586    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492589    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492591    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492594    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492597    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492599    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492602    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492604    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492607    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492609    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492612    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492616    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492618    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492621    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492624    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492626    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492631    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492635    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.493464 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492638    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492640    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492643    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492646    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492648    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492651    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492653    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492656    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492658    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492662    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492664    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492668    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492672    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492675    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492678    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492681    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492684    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492686    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492689    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492692    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.493934 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492694    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492697    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492699    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492702    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492704    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492707    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492711    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492714    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492717    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492719    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492722    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492724    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492727    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492729    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492732    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492735    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492737    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492740    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492742    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492745    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.494458 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492747    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492750    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492754    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492757    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492761    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492763    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492766    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492769    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492772    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492775    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492777    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492780    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492783    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492786    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492788    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492791    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492794    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492796    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492808    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.494954 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492814    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.492816    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493232    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493237    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493240    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493242    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493245    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493249    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493253    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493255    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493258    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493261    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493264    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493267    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493269    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493272    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493275    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493279    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493282    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.495431 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493284    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493286    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493289    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493291    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493294    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493297    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493299    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493302    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493305    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493307    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493310    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493312    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493315    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493318    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493320    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493323    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493325    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493328    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493331    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493333    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.495907 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493336    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493338    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493360    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493364    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493368    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493372    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493375    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493378    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493381    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493384    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493388    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493391    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493395    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493399    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493402    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493405    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493408    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493411    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493413    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.496436 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493417    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493420    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493423    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493426    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493429    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493431    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493434    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493438    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493441    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493444    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493446    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493449    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493452    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493455    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493458    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493460    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493463    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493465    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493468    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493471    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.496903 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493473    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493476    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493479    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493483    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493486    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493488    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493491    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493493    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493496    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493498    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493501    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493503    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493505    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493508    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493510    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493513    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493515    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493518    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493521    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493523    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.497450 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493526    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493529    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.493532    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493608    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493650    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493656    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493661    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493665    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493670    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493674    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493679    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493683    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493686    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493689    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493693    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493697    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493706    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493711    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493714    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493717    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493720    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493728    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493731    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493734    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 13:38:43.497944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493738    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493742    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493746    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493749    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493752    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493756    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493759    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493763    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493766    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493769    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493772    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493777    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493780    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493783    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493786    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493789    2584 flags.go:64] FLAG: --enable-server="true"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493792    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493799    2584 flags.go:64] FLAG: --event-burst="100"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493802    2584 flags.go:64] FLAG: --event-qps="50"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493805    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493808    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493812    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493816    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493819    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493822    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 13:38:43.498574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493830    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493834    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493837    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493840    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493843    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493846    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493849    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493852    2584 flags.go:64] FLAG: --feature-gates=""
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493856    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493861    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493864    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493867    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493871    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493874    2584 flags.go:64] FLAG: --help="false"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493879    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493882    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493885    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493889    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493892    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493896    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493898    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493901    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493904    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 13:38:43.499215 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493907    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493910    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493914    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493917    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493920    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493923    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493926    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493929    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493932    2584 flags.go:64] FLAG: --lock-file=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493935    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493939    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493943    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493949    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493952    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493955    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493958    2584 flags.go:64] FLAG: --logging-format="text"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493961    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493965    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493969    2584 flags.go:64] FLAG: --manifest-url=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493972    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493977    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493980    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493985    2584 flags.go:64] FLAG: --max-pods="110"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493989    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493992    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 13:38:43.499822 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493995    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.493998    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494001    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494004    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494007    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494015    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494018    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494021    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494025    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494028    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494034    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494037    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494041    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494044    2584 flags.go:64] FLAG: --port="10250"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494047    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494050    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ba2c07b987a5661"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494053    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494056    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494060    2584 flags.go:64] FLAG: --register-node="true"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494063    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494067    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494070    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494073    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494076    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494080    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 13:38:43.500480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494083    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494088    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494091    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494094    2584 flags.go:64] FLAG: --runonce="false"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494097    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494100    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494103    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494107    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494110    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494113    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494116    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494119    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494122    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494125    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494127    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494131    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494134    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494137    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494140    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494145    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494148    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494151    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494155    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494158    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494161    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 13:38:43.501108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494164    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494167    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494170    2584 flags.go:64] FLAG: --v="2"
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494174    2584 flags.go:64] FLAG: --version="false"
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494179    2584 flags.go:64] FLAG: --vmodule=""
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494182    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494186    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494311    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494317    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494320    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494323    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494326    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494328    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494331    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494334    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494337    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494340    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494342    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494345    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494347    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494365    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.501752 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494368    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494371    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494374    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494377    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494381    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494385    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494388    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494391    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494394    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494398    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494402    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494405    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494408    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494411    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494414    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494417    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494420    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494422    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494425    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.502276 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494429    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494432    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494435    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494438    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494441    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494444    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494447    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494449    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494452    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494455    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494457    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494460    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494463    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494466    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494468    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494471    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494474    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494477    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494479    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494482    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.502813 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494485    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494489    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494492    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494494    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494497    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494500    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494503    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494506    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494510    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494513    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494516    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494519    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494523    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494526    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494530    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494534    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494538    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494542    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494546    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494549    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.503288 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494551    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494554    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494557    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494560    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494562    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494565    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494568    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494570    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494573    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494576    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494579    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494581    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494584    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494588    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494591    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494594    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494596    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494600    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494602    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.503971 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494605    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494611    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494614    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494617    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494620    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494624    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.494626    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.494632    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.502649    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.502666    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.503883    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.503891    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503954    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503959    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503963    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.504460 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503965    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503968    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503971    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503975    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503978    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503981    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503984    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503987    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503990    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503992    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503995    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.503998    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504001    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504004    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504007    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504009    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504012    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504015    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504019    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504022    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.504844 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504025    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504028    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504030    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504034    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504036    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504039    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504042    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504044    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504047    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504050    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504053    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504055    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504058    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504061    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504063    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504066    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504069    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504072    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504074    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504077    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.505340 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504079    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504082    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504085    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504087    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504090    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504093    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504097    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504101    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504104    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504107    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504109    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504114    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504117    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504121    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504125    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504128    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504131    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504134    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504136    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.505875 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504139    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504142    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504144    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504147    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504149    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504152    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504154    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504157    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504159    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504162    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504164    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504167    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504170    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504173    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504175    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504178    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504181    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504183    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504190    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504193    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.506438 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504196    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504199    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504202    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504204    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504208    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504211    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504214    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504217    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504220    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504222    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504225    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504229    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504233    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504236    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504239    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504242    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.506921 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504244    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.504250    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504394    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504401    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504404    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504407    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504410    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504413    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504416    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504419    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504422    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504425    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504429    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504432    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 13:38:43.507316 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504435    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504438    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504441    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504444    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504447    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504450    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504453    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504456    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504459    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504462    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504465    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504468    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504471    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504473    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504476    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504479    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504481    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504484    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504486    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504489    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 13:38:43.507670 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504492    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504494    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504497    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504499    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504502    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504504    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504507    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504510    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504512    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504514    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504517    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504520    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504522    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504526    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504529    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504532    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504534    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504537    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504540    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504543    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 13:38:43.508161 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504545    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504548    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504551    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504554    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504557    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504559    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504562    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504565    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504567    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504570    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504572    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504575    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504577    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504580    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504582    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504585    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504587    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504590    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504592    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 13:38:43.508661 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504595    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504598    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504600    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504603    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504605    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504609    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504612    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504615    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504618    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504621    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504624    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504627    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504630    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504633    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504635    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504638    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504641    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504644    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504647    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504649    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 13:38:43.509098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504652    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504654    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504657    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504659    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504662    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504664    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504667    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:43.504669    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.504674    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.504804    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.507157    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.508237    2584 server.go:1019] "Starting client certificate rotation"
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.508343    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 13:38:43.509615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.508395    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 13:38:43.511225 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.511209    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 13:38:43.516371 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.516332    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 13:38:43.524425 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.524403    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 15 13:38:43.528674 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.528651    2584 log.go:25] "Validated CRI v1 image API"
Sep 15 13:38:43.530264 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.530247    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 13:38:43.534581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.534556    2584 fs.go:135] Filesystem UUIDs: map[340c3ca9-ccff-40b8-8dbd-7408d1f0d227:/dev/nvme0n1p4 38e254ce-83ca-4ca0-9bae-46c69520f791:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 15 13:38:43.534665 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.534580    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 13:38:43.540069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.539953    2584 manager.go:216] Machine: {Timestamp:2026-09-15 13:38:43.538545477 +0000 UTC m=+0.375520235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099919 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa06c82a93ef110e34166fdcdd457 SystemUUID:ec2fa06c-82a9-3ef1-10e3-4166fdcdd457 BootID:77816fd5-89e0-4314-976b-a5a8e05b3dc2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:b0:dd:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:b0:dd:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:e1:8a:2c:dd:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 13:38:43.540069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.540061    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 13:38:43.540198 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.540166    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 13:38:43.540266 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.540249    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 13:38:43.543712 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.543678    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 13:38:43.543855 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.543717    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-169.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 13:38:43.545229 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.545219    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 13:38:43.545262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.545232    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 13:38:43.545262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.545240    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 13:38:43.546030 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.546019    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 13:38:43.547261 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.547250    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 13:38:43.552012 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.551999    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 13:38:43.552198 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552188    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 13:38:43.552232 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552221    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 13:38:43.552232 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552231    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 13:38:43.552297 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552246    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 13:38:43.552297 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552255    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 15 13:38:43.552297 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552264    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 13:38:43.552718 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552707    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 13:38:43.552758 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.552728    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 13:38:43.555142 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.555126    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 13:38:43.558259 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.558240    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 13:38:43.558375 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.558279    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 13:38:43.560237 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560219    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bk9k2"
Sep 15 13:38:43.560363 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560339    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 13:38:43.560419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560381    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 13:38:43.560419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560397    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 13:38:43.560419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560408    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560426    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560435    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560457    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560465    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560475    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560483    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560496    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 13:38:43.560558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.560505    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 13:38:43.561468 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.561456    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 13:38:43.561518 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.561470    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 13:38:43.566281 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.566264    2584 server.go:1268] "Started kubelet"
Sep 15 13:38:43.566474 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.566408    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 13:38:43.566474 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.566444    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 13:38:43.566635 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.566490    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 13:38:43.567278 ip-10-0-134-169 systemd[1]: Started Kubernetes Kubelet.
Sep 15 13:38:43.568008 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.567978    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 13:38:43.568132 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.568081    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-169.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 13:38:43.568951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.568852    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 13:38:43.569019 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.568948    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bk9k2"
Sep 15 13:38:43.569935 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.568905    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 13:38:43.570050 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.568904    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 13:38:43.573298 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.572172    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-169.ec2.internal.18d5822547003797  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-169.ec2.internal,UID:ip-10-0-134-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-169.ec2.internal,},FirstTimestamp:2026-09-15 13:38:43.566237591 +0000 UTC m=+0.403212353,LastTimestamp:2026-09-15 13:38:43.566237591 +0000 UTC m=+0.403212353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-169.ec2.internal,}"
Sep 15 13:38:43.574028 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.574007    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 13:38:43.578337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.578318    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 13:38:43.578976 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.578963    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 13:38:43.579145 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.579119    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:43.579909 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579771    2584 factory.go:55] Registering systemd factory
Sep 15 13:38:43.579909 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579908    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 15 13:38:43.580041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579805    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 13:38:43.580041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579806    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 13:38:43.580041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579932    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 13:38:43.580041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579979    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 13:38:43.580041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.579987    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 13:38:43.580270 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580114    2584 factory.go:153] Registering CRI-O factory
Sep 15 13:38:43.580270 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580127    2584 factory.go:223] Registration of the crio container factory successfully
Sep 15 13:38:43.580270 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580192    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 13:38:43.580270 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580209    2584 factory.go:103] Registering Raw factory
Sep 15 13:38:43.580270 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580220    2584 manager.go:1196] Started watching for new ooms in manager
Sep 15 13:38:43.580906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.580883    2584 manager.go:349] Starting recovery of all containers
Sep 15 13:38:43.581842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.581815    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:43.586411 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.586388    2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-169.ec2.internal\" not found" node="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.592981 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.592964    2584 manager.go:354] Recovery completed
Sep 15 13:38:43.595343 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.595289    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 15 13:38:43.599636 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.599619    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.601627 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.601607    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.601699 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.601640    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.601699 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.601651    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.602228 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.602212    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 13:38:43.602228 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.602226    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.602339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.602227    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 13:38:43.602339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.602300    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 13:38:43.603002 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.602989    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.603062 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.603014    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.603062 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.603025    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.604461 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.604449    2584 policy_none.go:49] "None policy: Start"
Sep 15 13:38:43.604510 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.604465    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 13:38:43.604510 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.604475    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 13:38:43.606433 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.606422    2584 policy_none.go:47] "Start"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642071    2584 manager.go:337] "Starting Device Plugin manager"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.642110    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642121    2584 server.go:87] "Starting device plugin registration server"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642558    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642575    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642669    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642767    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.642776    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.643286    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 13:38:43.651701 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.643340    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:43.667631 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.667594    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 13:38:43.668849 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.668830    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 13:38:43.668950 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.668894    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 13:38:43.668950 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.668925    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 13:38:43.669044 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.668973    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 13:38:43.671169 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.671146    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:43.743346 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.743215    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.744264 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.744244    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.744380 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.744278    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.744380 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.744292    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.744380 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.744320    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.752150 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.752128    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.752262 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.752158    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-169.ec2.internal\": node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:43.763680 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.763654    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:43.769683 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.769665    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"]
Sep 15 13:38:43.769743 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.769731    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.771025 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.771012    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.771092 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.771039    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.771092 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.771049    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.773455 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.773443    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.773574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.773561    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.773622 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.773589    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.774205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774188    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.774273 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774217    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.774273 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774226    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.774273 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774189    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.774393 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774297    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.774393 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.774308    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.776490 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.776477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.776536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.776500    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 13:38:43.777156 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.777141    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 13:38:43.777205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.777170    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 13:38:43.777205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.777180    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID"
Sep 15 13:38:43.780252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.780093    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.780252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.780116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.780252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.780155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f20ece36e2cb445e1a70432e2a4cfba-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"2f20ece36e2cb445e1a70432e2a4cfba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.789921 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.789901    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-169.ec2.internal\" not found" node="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.793338 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.793321    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-169.ec2.internal\" not found" node="ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.864478 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.864450    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:43.880451 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.880581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880460    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.880581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.880581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f20ece36e2cb445e1a70432e2a4cfba-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"2f20ece36e2cb445e1a70432e2a4cfba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.880581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880578    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f20ece36e2cb445e1a70432e2a4cfba-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"2f20ece36e2cb445e1a70432e2a4cfba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.880727 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:43.880592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc7dd08500b93a2a8b7bc14904498a1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"fc7dd08500b93a2a8b7bc14904498a1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:43.965295 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:43.965260    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:44.066061 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:44.065996    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:44.092531 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:44.092500    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:44.095799 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:44.095781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:45.754067 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:45.754026    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:45.854638 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:45.854603    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:45.955226 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:45.955140    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:46.055719 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:46.055658    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:46.095267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.095227    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 13:38:46.095737 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.095403    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 13:38:46.095737 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.095411    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 13:38:46.155922 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:46.155882    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:46.163244 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.163209    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 13:33:45 +0000 UTC" deadline="2028-03-20 02:14:37.371573063 +0000 UTC"
Sep 15 13:38:46.163244 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.163242    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13236h35m51.208335061s"
Sep 15 13:38:46.173853 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.173831    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:46.256308 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:46.256232    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:46.332471 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:46.332438    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f20ece36e2cb445e1a70432e2a4cfba.slice/crio-6deb95b9e42ace98f9fea282f5f3282bbb783f4dd5a9fc83842c720b28f134f1 WatchSource:0}: Error finding container 6deb95b9e42ace98f9fea282f5f3282bbb783f4dd5a9fc83842c720b28f134f1: Status 404 returned error can't find the container with id 6deb95b9e42ace98f9fea282f5f3282bbb783f4dd5a9fc83842c720b28f134f1
Sep 15 13:38:46.335694 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.335679    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:38:46.356746 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:46.356710    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found"
Sep 15 13:38:46.448340 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.448311    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:46.467330 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.467307    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:46.478123 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.478104    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 13:38:46.479129 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.479115    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"
Sep 15 13:38:46.487052 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.487036    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 13:38:46.526253 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:46.526224    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7dd08500b93a2a8b7bc14904498a1d.slice/crio-111fea2f28500fdfddf313e7328a6be9dbc34c9f7ddd857835054da3e2f99422 WatchSource:0}: Error finding container 111fea2f28500fdfddf313e7328a6be9dbc34c9f7ddd857835054da3e2f99422: Status 404 returned error can't find the container with id 111fea2f28500fdfddf313e7328a6be9dbc34c9f7ddd857835054da3e2f99422
Sep 15 13:38:46.915243 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:46.915164    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:47.126026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.125998    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 13:38:47.140941 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.140907    2584 apiserver.go:52] "Watching apiserver"
Sep 15 13:38:47.151360 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.151332    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 13:38:47.152056 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.152034    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-kf5q9","openshift-multus/network-metrics-daemon-4jknc","kube-system/konnectivity-agent-wqp9v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv","openshift-cluster-node-tuning-operator/tuned-9sxtn","openshift-network-diagnostics/network-check-target-jn9zl","openshift-network-operator/iptables-alerter-xrvjn","openshift-ovn-kubernetes/ovnkube-node-rbzzr","kube-system/global-pull-secret-syncer-44z2n","kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal","openshift-dns/node-resolver-6q7cq","openshift-image-registry/node-ca-zt9tn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal","openshift-multus/multus-additional-cni-plugins-x22n5"]
Sep 15 13:38:47.154735 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.154720    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.156774 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.156749    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.157143 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.157121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqhnn\""
Sep 15 13:38:47.157143 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.157139    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.157293 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.157126    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 13:38:47.157293 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.157192    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.158748 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.158728    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9spgr\""
Sep 15 13:38:47.158748 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.158744    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.158921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.158811    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.159006 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.158986    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.161066 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.161050    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 13:38:47.161220 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.161201    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bdv7x\""
Sep 15 13:38:47.161289 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.161241    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 13:38:47.161408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.161388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.163541 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.163504    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 13:38:47.163541 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.163521    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.163718 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.163565    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cbz9x\""
Sep 15 13:38:47.163718 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.163572    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.163718 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.163525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.165780 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.165730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:47.165871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.165793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v86dx\""
Sep 15 13:38:47.165871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.165805    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 13:38:47.165871 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.165810    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:47.166095 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.166082    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.166151 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.166123    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.168021 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.168001    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.168119 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.168063    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:47.170278 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.170260    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.172442 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172402    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.172442 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172405    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxwkx\""
Sep 15 13:38:47.172712 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172695    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 13:38:47.172805 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172717    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.172805 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172745    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.172920 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.172815    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:47.172978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172926    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 13:38:47.172978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.172952    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 13:38:47.175237 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.175217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.176639 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysconfig\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.176744 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.176744 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-sys\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.176744 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176727    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4sd\" (UniqueName: \"kubernetes.io/projected/7bbaf482-6a11-4942-8cc1-29ee734d4975-kube-api-access-2h4sd\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30a14812-e5b3-44ca-838c-9cca83be1f8d-hosts-file\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxsr\" (UniqueName: \"kubernetes.io/projected/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kube-api-access-6sxsr\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176802    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-host\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-tmp\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bbaf482-6a11-4942-8cc1-29ee734d4975-iptables-alerter-script\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.176921 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176912    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-socket-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-kubelet-config\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.176986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/690bfaee-978d-425a-8e1d-4842bcefba0c-agent-certs\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177011    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-tuned\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bbaf482-6a11-4942-8cc1-29ee734d4975-host-slash\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-dbus\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177080    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-conf\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177142    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177102    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-systemd\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-run\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177197 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-lib-modules\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-var-lib-kubelet\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-modprobe-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a14812-e5b3-44ca-838c-9cca83be1f8d-tmp-dir\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177310    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-sys-fs\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/690bfaee-978d-425a-8e1d-4842bcefba0c-konnectivity-ca\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.177503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177395    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-kubernetes\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.177791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:47.177791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh59k\" (UniqueName: \"kubernetes.io/projected/30a14812-e5b3-44ca-838c-9cca83be1f8d-kube-api-access-fh59k\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.177791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.177682    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-registration-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.178043 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178023    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.178043 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178037    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-device-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.178175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plm6k\" (UniqueName: \"kubernetes.io/projected/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-kube-api-access-plm6k\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.178175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178101    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.178434 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178416    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 13:38:47.179719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.178991    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7v9md\""
Sep 15 13:38:47.179719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.179165    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.179719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.179283    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 13:38:47.179719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.179573    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 13:38:47.179719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.179572    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 13:38:47.179979 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.179841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.180362 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.180227    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 13:38:47.181494 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.180923    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f7cmq\""
Sep 15 13:38:47.182544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.182527    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.184620 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.184605    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 13:38:47.184865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.184850    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 13:38:47.184947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.184930    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-twdbz\""
Sep 15 13:38:47.185164 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.185149    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 13:38:47.216794 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.216770    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sgxdx"
Sep 15 13:38:47.224129 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.224109    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sgxdx"
Sep 15 13:38:47.260241 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.260194    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"fc7dd08500b93a2a8b7bc14904498a1d","Type":"ContainerStarted","Data":"111fea2f28500fdfddf313e7328a6be9dbc34c9f7ddd857835054da3e2f99422"}
Sep 15 13:38:47.261255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.261235    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" event={"ID":"2f20ece36e2cb445e1a70432e2a4cfba","Type":"ContainerStarted","Data":"6deb95b9e42ace98f9fea282f5f3282bbb783f4dd5a9fc83842c720b28f134f1"}
Sep 15 13:38:47.267959 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.267940    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 13:38:47.278929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.278896    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:47.278929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.278930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh59k\" (UniqueName: \"kubernetes.io/projected/30a14812-e5b3-44ca-838c-9cca83be1f8d-kube-api-access-fh59k\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.278947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-registration-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.278966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bbrt\" (UniqueName: \"kubernetes.io/projected/7ce24c24-943a-4ce4-84ef-c1250007388e-kube-api-access-8bbrt\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.278989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279013    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-slash\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279037    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-systemd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279055    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-registration-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.279140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279097    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-multus-certs\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-log-socket\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-hostroot\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279206    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tswmf\" (UniqueName: \"kubernetes.io/projected/6b682f9b-c411-41c1-96a0-84d00a22b000-kube-api-access-tswmf\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-node-log\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-config\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysconfig\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30a14812-e5b3-44ca-838c-9cca83be1f8d-hosts-file\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxsr\" (UniqueName: \"kubernetes.io/projected/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kube-api-access-6sxsr\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279394    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-cnibin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-bin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279428    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysconfig\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.279478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/36a140e3-e410-4d68-adc7-f92983bd75b8-kube-api-access-j5qfq\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-kubelet-config\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279493    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30a14812-e5b3-44ca-838c-9cca83be1f8d-hosts-file\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/690bfaee-978d-425a-8e1d-4842bcefba0c-agent-certs\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-kubelet-config\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279581    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-multus\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b682f9b-c411-41c1-96a0-84d00a22b000-host\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.279634    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-tuned\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bbaf482-6a11-4942-8cc1-29ee734d4975-host-slash\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-dbus\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bbaf482-6a11-4942-8cc1-29ee734d4975-host-slash\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.279745    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:47.779719232 +0000 UTC m=+3.029380505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63292c14-fa9c-41ff-96ca-2347852d9c34-dbus\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-systemd\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.279987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-kubelet\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-netns\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279890    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-systemd\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-ovn\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279924    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a14812-e5b3-44ca-838c-9cca83be1f8d-tmp-dir\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-sys-fs\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.279994    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-k8s-cni-cncf-io\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-netd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-kubernetes\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-sys-fs\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-kubelet\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-daemon-config\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280146    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b682f9b-c411-41c1-96a0-84d00a22b000-serviceca\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280166    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-etc-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.280715 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280180    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-kubernetes\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-device-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280225    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-socket-dir-parent\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280206    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a14812-e5b3-44ca-838c-9cca83be1f8d-tmp-dir\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-conf-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-device-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280290    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-var-lib-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plm6k\" (UniqueName: \"kubernetes.io/projected/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-kube-api-access-plm6k\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280310    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-cnibin\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280374    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fpc\" (UniqueName: \"kubernetes.io/projected/378ecd87-0224-4d80-88f7-b64aee047bb4-kube-api-access-98fpc\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280412    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-env-overrides\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.281408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-sys\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4sd\" (UniqueName: \"kubernetes.io/projected/7bbaf482-6a11-4942-8cc1-29ee734d4975-kube-api-access-2h4sd\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-sys\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280571    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-cni-binary-copy\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-systemd-units\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280643    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-host\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-tmp\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-host\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bbaf482-6a11-4942-8cc1-29ee734d4975-iptables-alerter-script\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-socket-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-bin\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280840    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-script-lib\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e66873ca-ac3e-426f-9554-9afd8d5b9c26-socket-dir\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.282339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280898    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-system-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280923    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-etc-kubernetes\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280946    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.280980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-conf\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-run\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281072    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-lib-modules\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281092    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-sysctl-conf\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-run\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-var-lib-kubelet\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-netns\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-modprobe-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/690bfaee-978d-425a-8e1d-4842bcefba0c-konnectivity-ca\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-lib-modules\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-var-lib-kubelet\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-modprobe-d\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.282962 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvm6p\" (UniqueName: \"kubernetes.io/projected/c2e8dd05-5f76-4d6c-b121-28df15fba593-kube-api-access-fvm6p\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.283488 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/690bfaee-978d-425a-8e1d-4842bcefba0c-konnectivity-ca\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.283488 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.281870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bbaf482-6a11-4942-8cc1-29ee734d4975-iptables-alerter-script\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.284374 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.284189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-etc-tuned\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.284459 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.284418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/690bfaee-978d-425a-8e1d-4842bcefba0c-agent-certs\") pod \"konnectivity-agent-wqp9v\" (UID: \"690bfaee-978d-425a-8e1d-4842bcefba0c\") " pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.284507 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.284494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-tmp\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.285369 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.285353    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:47.285416 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.285374    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:47.285416 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.285384    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:47.285481 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.285438    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:47.785425146 +0000 UTC m=+3.035086417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:47.287428 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.287402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh59k\" (UniqueName: \"kubernetes.io/projected/30a14812-e5b3-44ca-838c-9cca83be1f8d-kube-api-access-fh59k\") pod \"node-resolver-6q7cq\" (UID: \"30a14812-e5b3-44ca-838c-9cca83be1f8d\") " pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.288255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.288236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plm6k\" (UniqueName: \"kubernetes.io/projected/45e0a5fa-f6ca-43d6-ad78-8a68230415ab-kube-api-access-plm6k\") pod \"tuned-9sxtn\" (UID: \"45e0a5fa-f6ca-43d6-ad78-8a68230415ab\") " pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.288255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.288253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4sd\" (UniqueName: \"kubernetes.io/projected/7bbaf482-6a11-4942-8cc1-29ee734d4975-kube-api-access-2h4sd\") pod \"iptables-alerter-xrvjn\" (UID: \"7bbaf482-6a11-4942-8cc1-29ee734d4975\") " pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.288722 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.288702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxsr\" (UniqueName: \"kubernetes.io/projected/e66873ca-ac3e-426f-9554-9afd8d5b9c26-kube-api-access-6sxsr\") pod \"aws-ebs-csi-driver-node-xwdbv\" (UID: \"e66873ca-ac3e-426f-9554-9afd8d5b9c26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.381920 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.381879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-socket-dir-parent\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.381920 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.381926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-conf-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.381948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.381972    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-var-lib-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.381988    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-cnibin\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fpc\" (UniqueName: \"kubernetes.io/projected/378ecd87-0224-4d80-88f7-b64aee047bb4-kube-api-access-98fpc\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-env-overrides\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382029    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-conf-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-cni-binary-copy\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-socket-dir-parent\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-var-lib-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-systemd-units\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.382156    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.382216    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:47.882196086 +0000 UTC m=+3.131857364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382414    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-systemd-units\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-bin\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382457    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-script-lib\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382449    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-cnibin\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-system-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-etc-kubernetes\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382510    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.382553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382543    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-netns\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382608    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-env-overrides\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvm6p\" (UniqueName: \"kubernetes.io/projected/c2e8dd05-5f76-4d6c-b121-28df15fba593-kube-api-access-fvm6p\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382698    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bbrt\" (UniqueName: \"kubernetes.io/projected/7ce24c24-943a-4ce4-84ef-c1250007388e-kube-api-access-8bbrt\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-etc-kubernetes\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-slash\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382776    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-systemd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-multus-certs\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-log-socket\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382835    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-log-socket\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382891    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-netns\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382898    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-systemd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.383214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382939    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-slash\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-multus-certs\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.382988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-bin\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383019    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-system-cni-dir\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-hostroot\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383065    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-cni-binary-copy\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383085    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tswmf\" (UniqueName: \"kubernetes.io/projected/6b682f9b-c411-41c1-96a0-84d00a22b000-kube-api-access-tswmf\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-node-log\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/378ecd87-0224-4d80-88f7-b64aee047bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-config\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-hostroot\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-cnibin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-bin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383153    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383172    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-node-log\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/36a140e3-e410-4d68-adc7-f92983bd75b8-kube-api-access-j5qfq\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.384086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-cnibin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-bin\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-multus\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b682f9b-c411-41c1-96a0-84d00a22b000-host\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-script-lib\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-kubelet\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383297    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b682f9b-c411-41c1-96a0-84d00a22b000-host\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-netns\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-cni-multus\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-ovn\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-k8s-cni-cncf-io\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383370    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-netd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-cni-netd\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-netns\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-kubelet\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-run-ovn\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.384765 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-daemon-config\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383484    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b682f9b-c411-41c1-96a0-84d00a22b000-serviceca\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383473    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-run-k8s-cni-cncf-io\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-etc-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383528    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-kubelet\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383601    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce24c24-943a-4ce4-84ef-c1250007388e-host-var-lib-kubelet\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2e8dd05-5f76-4d6c-b121-28df15fba593-etc-openvswitch\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383778    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovnkube-config\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.383808    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/378ecd87-0224-4d80-88f7-b64aee047bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.384022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ce24c24-943a-4ce4-84ef-c1250007388e-multus-daemon-config\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.385369 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.384052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b682f9b-c411-41c1-96a0-84d00a22b000-serviceca\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.385918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.385633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2e8dd05-5f76-4d6c-b121-28df15fba593-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.391848 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.391821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fpc\" (UniqueName: \"kubernetes.io/projected/378ecd87-0224-4d80-88f7-b64aee047bb4-kube-api-access-98fpc\") pod \"multus-additional-cni-plugins-x22n5\" (UID: \"378ecd87-0224-4d80-88f7-b64aee047bb4\") " pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.391971 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.391883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5qfq\" (UniqueName: \"kubernetes.io/projected/36a140e3-e410-4d68-adc7-f92983bd75b8-kube-api-access-j5qfq\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.392422 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.392400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvm6p\" (UniqueName: \"kubernetes.io/projected/c2e8dd05-5f76-4d6c-b121-28df15fba593-kube-api-access-fvm6p\") pod \"ovnkube-node-rbzzr\" (UID: \"c2e8dd05-5f76-4d6c-b121-28df15fba593\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.392506 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.392465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bbrt\" (UniqueName: \"kubernetes.io/projected/7ce24c24-943a-4ce4-84ef-c1250007388e-kube-api-access-8bbrt\") pod \"multus-kf5q9\" (UID: \"7ce24c24-943a-4ce4-84ef-c1250007388e\") " pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.392826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.392810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tswmf\" (UniqueName: \"kubernetes.io/projected/6b682f9b-c411-41c1-96a0-84d00a22b000-kube-api-access-tswmf\") pod \"node-ca-zt9tn\" (UID: \"6b682f9b-c411-41c1-96a0-84d00a22b000\") " pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.464755 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.464643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xrvjn"
Sep 15 13:38:47.471174 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.471142    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6q7cq"
Sep 15 13:38:47.477560 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.477391    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbaf482_6a11_4942_8cc1_29ee734d4975.slice/crio-dbd3cf231bbd51086dd063c6a2bbedffbbd350883058e9c9c70d060fb4cb8cf3 WatchSource:0}: Error finding container dbd3cf231bbd51086dd063c6a2bbedffbbd350883058e9c9c70d060fb4cb8cf3: Status 404 returned error can't find the container with id dbd3cf231bbd51086dd063c6a2bbedffbbd350883058e9c9c70d060fb4cb8cf3
Sep 15 13:38:47.479834 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.479650    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:38:47.482351 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.482319    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a14812_e5b3_44ca_838c_9cca83be1f8d.slice/crio-bc533562ba1d27b059e48beed61ac6ff418e419b5ffaafd42d2c7d7e0214628b WatchSource:0}: Error finding container bc533562ba1d27b059e48beed61ac6ff418e419b5ffaafd42d2c7d7e0214628b: Status 404 returned error can't find the container with id bc533562ba1d27b059e48beed61ac6ff418e419b5ffaafd42d2c7d7e0214628b
Sep 15 13:38:47.484107 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.484084    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv"
Sep 15 13:38:47.488724 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.488698    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690bfaee_978d_425a_8e1d_4842bcefba0c.slice/crio-16a3a4571282afb2513fa3499fcf613744b5b320bf79d4e89bb856cd9130e5e2 WatchSource:0}: Error finding container 16a3a4571282afb2513fa3499fcf613744b5b320bf79d4e89bb856cd9130e5e2: Status 404 returned error can't find the container with id 16a3a4571282afb2513fa3499fcf613744b5b320bf79d4e89bb856cd9130e5e2
Sep 15 13:38:47.493589 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.493565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sxtn"
Sep 15 13:38:47.494197 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.494166    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66873ca_ac3e_426f_9554_9afd8d5b9c26.slice/crio-49d15bc331629cadad14677b0faa124f85e308e1b684d843f442a5fa4d0e728f WatchSource:0}: Error finding container 49d15bc331629cadad14677b0faa124f85e308e1b684d843f442a5fa4d0e728f: Status 404 returned error can't find the container with id 49d15bc331629cadad14677b0faa124f85e308e1b684d843f442a5fa4d0e728f
Sep 15 13:38:47.498473 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.498427    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x22n5"
Sep 15 13:38:47.503744 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.503714    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e0a5fa_f6ca_43d6_ad78_8a68230415ab.slice/crio-88a365e8f896e1835687bb19ae8a837bc812504c1b4d6c0e71e4cfbca5089695 WatchSource:0}: Error finding container 88a365e8f896e1835687bb19ae8a837bc812504c1b4d6c0e71e4cfbca5089695: Status 404 returned error can't find the container with id 88a365e8f896e1835687bb19ae8a837bc812504c1b4d6c0e71e4cfbca5089695
Sep 15 13:38:47.504642 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.504617    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:38:47.508440 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.508412    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378ecd87_0224_4d80_88f7_b64aee047bb4.slice/crio-a80e0a8de5b54a45b549b09c3c06a0c3b3895706541e7fd41163aca9f85920df WatchSource:0}: Error finding container a80e0a8de5b54a45b549b09c3c06a0c3b3895706541e7fd41163aca9f85920df: Status 404 returned error can't find the container with id a80e0a8de5b54a45b549b09c3c06a0c3b3895706541e7fd41163aca9f85920df
Sep 15 13:38:47.509482 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.509463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf5q9"
Sep 15 13:38:47.513981 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.513956    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e8dd05_5f76_4d6c_b121_28df15fba593.slice/crio-b1872435f649a0bf6ccd65a9899938cc69066c95f6782a5bfd5c9889189b9aac WatchSource:0}: Error finding container b1872435f649a0bf6ccd65a9899938cc69066c95f6782a5bfd5c9889189b9aac: Status 404 returned error can't find the container with id b1872435f649a0bf6ccd65a9899938cc69066c95f6782a5bfd5c9889189b9aac
Sep 15 13:38:47.513981 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.513979    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zt9tn"
Sep 15 13:38:47.519571 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.519540    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce24c24_943a_4ce4_84ef_c1250007388e.slice/crio-34c0b0ce4c59aa26bcf28de7034da7d987b2e4717227d81c0b3c913aea2879b0 WatchSource:0}: Error finding container 34c0b0ce4c59aa26bcf28de7034da7d987b2e4717227d81c0b3c913aea2879b0: Status 404 returned error can't find the container with id 34c0b0ce4c59aa26bcf28de7034da7d987b2e4717227d81c0b3c913aea2879b0
Sep 15 13:38:47.525236 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:38:47.525208    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b682f9b_c411_41c1_96a0_84d00a22b000.slice/crio-50ad60da7a116da9fbdb481c6de733d92e54c3fc9784b8273de01f80b3510c0a WatchSource:0}: Error finding container 50ad60da7a116da9fbdb481c6de733d92e54c3fc9784b8273de01f80b3510c0a: Status 404 returned error can't find the container with id 50ad60da7a116da9fbdb481c6de733d92e54c3fc9784b8273de01f80b3510c0a
Sep 15 13:38:47.786716 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.786627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:47.786716 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.786706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786802    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786813    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786828    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786842    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786874    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:48.786856739 +0000 UTC m=+4.036518017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:47.786910 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.786897    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:48.786880501 +0000 UTC m=+4.036541776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:47.887324 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:47.887280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:47.887483 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.887466    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:47.887563 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:47.887548    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:48.887528234 +0000 UTC m=+4.137189512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:48.227931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.227826    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 13:33:47 +0000 UTC" deadline="2028-06-08 13:06:26.561725666 +0000 UTC"
Sep 15 13:38:48.227931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.227883    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15167h27m38.33384705s"
Sep 15 13:38:48.257302 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.257272    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:48.257472 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.257391    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:48.264906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.264867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf5q9" event={"ID":"7ce24c24-943a-4ce4-84ef-c1250007388e","Type":"ContainerStarted","Data":"34c0b0ce4c59aa26bcf28de7034da7d987b2e4717227d81c0b3c913aea2879b0"}
Sep 15 13:38:48.266149 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.266114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerStarted","Data":"a80e0a8de5b54a45b549b09c3c06a0c3b3895706541e7fd41163aca9f85920df"}
Sep 15 13:38:48.267362 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.267335    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqp9v" event={"ID":"690bfaee-978d-425a-8e1d-4842bcefba0c","Type":"ContainerStarted","Data":"16a3a4571282afb2513fa3499fcf613744b5b320bf79d4e89bb856cd9130e5e2"}
Sep 15 13:38:48.268603 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.268578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xrvjn" event={"ID":"7bbaf482-6a11-4942-8cc1-29ee734d4975","Type":"ContainerStarted","Data":"dbd3cf231bbd51086dd063c6a2bbedffbbd350883058e9c9c70d060fb4cb8cf3"}
Sep 15 13:38:48.269811 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.269791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zt9tn" event={"ID":"6b682f9b-c411-41c1-96a0-84d00a22b000","Type":"ContainerStarted","Data":"50ad60da7a116da9fbdb481c6de733d92e54c3fc9784b8273de01f80b3510c0a"}
Sep 15 13:38:48.271139 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.271112    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"b1872435f649a0bf6ccd65a9899938cc69066c95f6782a5bfd5c9889189b9aac"}
Sep 15 13:38:48.272513 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.272489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sxtn" event={"ID":"45e0a5fa-f6ca-43d6-ad78-8a68230415ab","Type":"ContainerStarted","Data":"88a365e8f896e1835687bb19ae8a837bc812504c1b4d6c0e71e4cfbca5089695"}
Sep 15 13:38:48.273796 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.273769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv" event={"ID":"e66873ca-ac3e-426f-9554-9afd8d5b9c26","Type":"ContainerStarted","Data":"49d15bc331629cadad14677b0faa124f85e308e1b684d843f442a5fa4d0e728f"}
Sep 15 13:38:48.275119 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.275100    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6q7cq" event={"ID":"30a14812-e5b3-44ca-838c-9cca83be1f8d","Type":"ContainerStarted","Data":"bc533562ba1d27b059e48beed61ac6ff418e419b5ffaafd42d2c7d7e0214628b"}
Sep 15 13:38:48.792559 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.792519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:48.792774 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.792589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:48.792774 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792719    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:48.792892 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792784    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:50.792764627 +0000 UTC m=+6.042425922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:48.792892 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792722    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:48.792892 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792819    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:48.792892 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792835    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:48.792892 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.792873    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:50.792861514 +0000 UTC m=+6.042522804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:48.893841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:48.893813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:48.894012 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.893987    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:48.894099 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:48.894071    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:50.894048392 +0000 UTC m=+6.143709669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:49.229256 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:49.228841    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 13:33:47 +0000 UTC" deadline="2028-02-23 07:58:47.482140956 +0000 UTC"
Sep 15 13:38:49.229256 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:49.228884    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12618h19m58.253261722s"
Sep 15 13:38:49.257441 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:49.257387    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:49.257597 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:49.257393    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:49.257597 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:49.257517    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:49.257740 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:49.257610    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:49.290472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:49.290433    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" event={"ID":"2f20ece36e2cb445e1a70432e2a4cfba","Type":"ContainerStarted","Data":"e989f5acb89d333f58591c06aca324047a10b10e186360959ecab95c3f645be7"}
Sep 15 13:38:50.256748 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.256645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:50.257349 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.256802    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:50.300555 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.299265    2584 generic.go:356] "Generic (PLEG): container finished" podID="fc7dd08500b93a2a8b7bc14904498a1d" containerID="6394f18a6fbd5833b7e852fe8c932a7d51924307ba0bc83b8a5dfe1d51eac0f9" exitCode=0
Sep 15 13:38:50.300555 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.300312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"fc7dd08500b93a2a8b7bc14904498a1d","Type":"ContainerDied","Data":"6394f18a6fbd5833b7e852fe8c932a7d51924307ba0bc83b8a5dfe1d51eac0f9"}
Sep 15 13:38:50.315008 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.314001    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" podStartSLOduration=4.313977232 podStartE2EDuration="4.313977232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:38:49.305840739 +0000 UTC m=+4.555502037" watchObservedRunningTime="2026-09-15 13:38:50.313977232 +0000 UTC m=+5.563638523"
Sep 15 13:38:50.810926 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.810884    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:50.811102 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.810948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:50.811102 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811082    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:50.811220 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811148    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:54.811129431 +0000 UTC m=+10.060790706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:50.811470 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811446    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:50.811547 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811481    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:50.811547 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811495    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:50.811637 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.811552    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:54.811535432 +0000 UTC m=+10.061196711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:50.912108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:50.912066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:50.912276 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.912214    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:50.912350 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:50.912283    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:38:54.912264069 +0000 UTC m=+10.161925358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:51.257276 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:51.257182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:51.257755 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:51.257337    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:51.257824 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:51.257803    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:51.257920 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:51.257898    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:52.257276 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:52.256760    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:52.257276 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:52.256912    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:53.257316 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:53.256766    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:53.257316 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:53.256906    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:53.257316 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:53.257004    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:53.257316 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:53.257123    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:54.257288 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:54.257210    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:54.257437 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.257339    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:54.847898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:54.847863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:54.848091 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:54.847915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:54.848091 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848028    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:54.848091 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848091    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:02.848071446 +0000 UTC m=+18.097732720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:38:54.848257 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848133    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:38:54.848257 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848161    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:38:54.848257 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848177    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:54.848257 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.848229    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:02.848214195 +0000 UTC m=+18.097875468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:38:54.949254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:54.949210    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:54.949419 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.949398    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:54.949496 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:54.949480    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:02.949457942 +0000 UTC m=+18.199119223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:38:55.257431 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:55.257348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:55.257894 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:55.257487    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:55.257894 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:55.257515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:55.257894 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:55.257627    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:56.257326 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:56.257283    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:56.257487 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:56.257422    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:57.257009 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:57.256974    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:57.257180 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:57.256974    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:57.257180 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:57.257097    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:38:57.257263 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:57.257202    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:58.256676 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:58.256642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:38:58.257112 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:58.256775    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:38:59.256740 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:59.256688    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:38:59.256740 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:38:59.256730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:38:59.257263 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:59.256826    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:38:59.257263 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:38:59.257000    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:00.257172 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:00.257131    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:00.257650 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:00.257276    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:01.256917 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:01.256876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:01.257113 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:01.256875    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:01.257113 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:01.257040    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:01.257113 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:01.257094    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:02.257278 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:02.257193    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:02.257775 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.257311    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:02.910467 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:02.910267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:02.910633 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:02.910533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:02.910633 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910431    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:02.910633 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910621    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:39:02.910633 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910633    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:18.910611029 +0000 UTC m=+34.160272306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:02.910816 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910641    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:39:02.910816 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910650    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:02.910816 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:02.910705    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:18.910691408 +0000 UTC m=+34.160352680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:03.011401 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:03.011360    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:03.011584 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:03.011485    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:03.011584 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:03.011558    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:19.011542569 +0000 UTC m=+34.261203841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:03.257395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:03.257305    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:03.257849 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:03.257305    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:03.257849 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:03.257459    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:03.257849 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:03.257523    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:04.256685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:04.256642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:04.256881 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:04.256797    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:05.258478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:05.258434    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:05.258927 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:05.258493    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:05.258927 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:05.258640    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:05.258927 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:05.258833    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:06.257377 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.257205    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:06.257497 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:06.257478    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:06.332166 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.332134    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6q7cq" event={"ID":"30a14812-e5b3-44ca-838c-9cca83be1f8d","Type":"ContainerStarted","Data":"0b4fd44a2f70d1e2452e3453f8219531f110b1cb14d9c3f00cc2ad81e953a551"}
Sep 15 13:39:06.333847 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.333817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf5q9" event={"ID":"7ce24c24-943a-4ce4-84ef-c1250007388e","Type":"ContainerStarted","Data":"829b27fa0fa47dc82af68910db2a46c873ac0634710555757fe3327b64aecd66"}
Sep 15 13:39:06.335483 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.335457    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="c68ce02e17b3549bc2ffea5c4df0857b35e907619cabb7a7e2b62e6a0ae1f3ba" exitCode=0
Sep 15 13:39:06.335574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.335537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"c68ce02e17b3549bc2ffea5c4df0857b35e907619cabb7a7e2b62e6a0ae1f3ba"}
Sep 15 13:39:06.340195 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.340171    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqp9v" event={"ID":"690bfaee-978d-425a-8e1d-4842bcefba0c","Type":"ContainerStarted","Data":"643e35681dd6a1a49a283d9997a66b5494465f377d4d8c5756839e55d5353fce"}
Sep 15 13:39:06.341993 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.341972    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"fc7dd08500b93a2a8b7bc14904498a1d","Type":"ContainerStarted","Data":"af59acca570b67a2a7108fb3cc8102a13cd6e5d18857f9c53d9ceef4b3947599"}
Sep 15 13:39:06.343419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.343396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zt9tn" event={"ID":"6b682f9b-c411-41c1-96a0-84d00a22b000","Type":"ContainerStarted","Data":"676b57122439d33f14765a9a7b7b40e84385c6389919aee4767c04890352b7f8"}
Sep 15 13:39:06.345835 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.345807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"e211dd73853f15cbf736a6d132955924c305fa121290213630523dc4fa3eca50"}
Sep 15 13:39:06.345908 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.345862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"9add351052a367f9bdbc3274352b14c90e5830a239d58839d2811f62354cd9b4"}
Sep 15 13:39:06.345908 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.345902    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"3f6e3f9fe52133db2090f84bf6c539851fd897ad3ce4542d0c872393bc4546ca"}
Sep 15 13:39:06.346039 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.345930    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"d4cf1c3c9ade5494413ddab44a481f070f710c84b7684acd545662a7691350c2"}
Sep 15 13:39:06.347891 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.347863    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sxtn" event={"ID":"45e0a5fa-f6ca-43d6-ad78-8a68230415ab","Type":"ContainerStarted","Data":"195b31cd97916e28000f00457a1e7fdc232787b90677ff040e651ad33882d2f7"}
Sep 15 13:39:06.349376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.349358    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv" event={"ID":"e66873ca-ac3e-426f-9554-9afd8d5b9c26","Type":"ContainerStarted","Data":"cfccc39abf89bef689e7dcd240269f3bd025fe1df5309d2f31935a4c58a0c69d"}
Sep 15 13:39:06.349752 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.349702    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6q7cq" podStartSLOduration=3.233258651 podStartE2EDuration="21.34965381s" totalImagesPullingTime="18.116395159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.348842894 +0000 UTC m=+21.598504203" watchObservedRunningTime="2026-09-15 13:39:06.34965381 +0000 UTC m=+21.599315105"
Sep 15 13:39:06.367402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.367355    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" podStartSLOduration=20.36734172 podStartE2EDuration="20.36734172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.367066146 +0000 UTC m=+21.616727440" watchObservedRunningTime="2026-09-15 13:39:06.36734172 +0000 UTC m=+21.617003013"
Sep 15 13:39:06.386065 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.386013    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sxtn" podStartSLOduration=3.073619561 podStartE2EDuration="21.385994231s" totalImagesPullingTime="18.31237467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.385962326 +0000 UTC m=+21.635623637" watchObservedRunningTime="2026-09-15 13:39:06.385994231 +0000 UTC m=+21.635655522"
Sep 15 13:39:06.417758 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.417719    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zt9tn" podStartSLOduration=7.018740189 podStartE2EDuration="21.417703056s" totalImagesPullingTime="14.398962867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.417389229 +0000 UTC m=+21.667050526" watchObservedRunningTime="2026-09-15 13:39:06.417703056 +0000 UTC m=+21.667364347"
Sep 15 13:39:06.417913 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.417896    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kf5q9" podStartSLOduration=2.929186376 podStartE2EDuration="21.417888337s" totalImagesPullingTime="18.488701961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.40288304 +0000 UTC m=+21.652544362" watchObservedRunningTime="2026-09-15 13:39:06.417888337 +0000 UTC m=+21.667549633"
Sep 15 13:39:06.454289 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:06.454240    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqp9v" podStartSLOduration=7.018609812 podStartE2EDuration="21.454222605s" totalImagesPullingTime="14.435612793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:06.430987319 +0000 UTC m=+21.680648633" watchObservedRunningTime="2026-09-15 13:39:06.454222605 +0000 UTC m=+21.703883898"
Sep 15 13:39:07.256712 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.256655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:07.256930 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:07.256808    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:07.256930 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.256852    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:07.257042 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:07.256951    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:07.353522 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.353477    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xrvjn" event={"ID":"7bbaf482-6a11-4942-8cc1-29ee734d4975","Type":"ContainerStarted","Data":"ca20928cf1022554fc14177c01ebb516ec39a37e65b5ba36c39880135d59ba19"}
Sep 15 13:39:07.357139 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.357104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"49200cd1812560c043c6dad6dc3bafec4e59e73a367a25fa1c1220fc9caaf0d7"}
Sep 15 13:39:07.357283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.357183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"7b91d9892a1f0ec93420b4f812fbfc990925a327c268f4602485886322f799ea"}
Sep 15 13:39:07.368482 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:07.368386    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xrvjn" podStartSLOduration=4.031258811 podStartE2EDuration="22.368367693s" totalImagesPullingTime="18.337108882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:07.368050466 +0000 UTC m=+22.617711780" watchObservedRunningTime="2026-09-15 13:39:07.368367693 +0000 UTC m=+22.618028984"
Sep 15 13:39:08.256873 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:08.256840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:08.257039 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:08.256948    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:08.582914 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:08.582655    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 13:39:09.242622 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.242461    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T13:39:08.582909093Z","UUID":"2b711b02-51f9-4c22-a643-c89d4a3fb0a0","Handler":null,"Name":"","Endpoint":""}
Sep 15 13:39:09.244404 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.244374    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 13:39:09.244519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.244412    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 13:39:09.256813 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.256765    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:09.256977 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:09.256890    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:09.256977 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.256927    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:09.257098 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:09.257007    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:09.366546 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.366508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"32526de80eba8f5e4456056923c153d369c736a35b7a125019c24388c424a234"}
Sep 15 13:39:09.368820 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:09.368785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv" event={"ID":"e66873ca-ac3e-426f-9554-9afd8d5b9c26","Type":"ContainerStarted","Data":"68c6bce0d463b7b1eac9ba2f809841689bce6625bc6e16cc34df5c705be5e2df"}
Sep 15 13:39:10.256950 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.256917    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:10.257426 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:10.257027    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:10.312622 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.312587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:39:10.313609 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.313579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:39:10.373642 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.373605    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv" event={"ID":"e66873ca-ac3e-426f-9554-9afd8d5b9c26","Type":"ContainerStarted","Data":"3ec54a2af5a7246fcc53cfd5d97b9ad2d12e1620c8c7c2e44d159c90f7cbfabd"}
Sep 15 13:39:10.373885 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.373868    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:39:10.375813 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.374651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqp9v"
Sep 15 13:39:10.407508 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:10.407455    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwdbv" podStartSLOduration=3.796854567 podStartE2EDuration="25.407436581s" totalImagesPullingTime="21.610582014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:10.391505384 +0000 UTC m=+25.641166704" watchObservedRunningTime="2026-09-15 13:39:10.407436581 +0000 UTC m=+25.657097937"
Sep 15 13:39:11.257310 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:11.257274    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:11.257796 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:11.257274    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:11.257796 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:11.257427    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:11.257796 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:11.257494    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:12.257595 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:12.257369    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:12.258121 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:12.257616    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:12.379498 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:12.379461    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="6c446addf7ccbca54b717c7df221631bdce04e327cdf8f615d57564b914ca8c3" exitCode=0
Sep 15 13:39:12.379701 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:12.379551    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"6c446addf7ccbca54b717c7df221631bdce04e327cdf8f615d57564b914ca8c3"}
Sep 15 13:39:12.383721 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:12.383693    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" event={"ID":"c2e8dd05-5f76-4d6c-b121-28df15fba593","Type":"ContainerStarted","Data":"b8604dc97f64a82455bd6e22e36ac66640fc24c42d46370865a419b5851f0d4e"}
Sep 15 13:39:12.427865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:12.427815    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr" podStartSLOduration=9.088537464 podStartE2EDuration="27.427798133s" totalImagesPullingTime="18.339260669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:12.426417863 +0000 UTC m=+27.676079157" watchObservedRunningTime="2026-09-15 13:39:12.427798133 +0000 UTC m=+27.677459430"
Sep 15 13:39:13.256534 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.256499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:13.256804 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:13.256613    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:13.256804 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.256685    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:13.256804 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:13.256767    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:13.385996 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.385964    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:13.386584 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.386052    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:13.386584 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.386102    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:13.400958 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.400933    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:13.401252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:13.401235    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:14.256469 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:14.256439    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:14.256603 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:14.256549    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:14.390273 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:14.390193    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="76ac6865daf6c41d97daf50e54c0c014f964e9321899ffdf0c4dec8d93a0f83f" exitCode=0
Sep 15 13:39:14.390861 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:14.390280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"76ac6865daf6c41d97daf50e54c0c014f964e9321899ffdf0c4dec8d93a0f83f"}
Sep 15 13:39:15.258122 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:15.258095    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:15.258224 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:15.258186    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:15.258267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:15.258241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:15.258315 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:15.258302    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:15.282971 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:15.282935    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378ecd87_0224_4d80_88f7_b64aee047bb4.slice/crio-conmon-7e7e65ec9dc7e26ef557c62068fadbc8ff5c4ed7cd0860998a28641e6fdfd02d.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 13:39:15.394725 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:15.394694    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="7e7e65ec9dc7e26ef557c62068fadbc8ff5c4ed7cd0860998a28641e6fdfd02d" exitCode=0
Sep 15 13:39:15.395180 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:15.394759    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"7e7e65ec9dc7e26ef557c62068fadbc8ff5c4ed7cd0860998a28641e6fdfd02d"}
Sep 15 13:39:16.257266 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:16.257231    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:16.257456 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:16.257360    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:17.256944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:17.256907    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:17.257400 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:17.256907    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:17.257400 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:17.257072    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:17.257400 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:17.257130    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:18.257423 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:18.257384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:18.257877 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.257499    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:18.932056 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:18.932017    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:18.932250 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:18.932076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:18.932250 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932192    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:18.932250 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932213    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 13:39:18.932250 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932241    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 13:39:18.932250 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932254    2584 projected.go:196] Error preparing data for projected volume kube-api-access-nnt4g for pod openshift-network-diagnostics/network-check-target-jn9zl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:18.932499 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932266    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret podName:63292c14-fa9c-41ff-96ca-2347852d9c34 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:50.932245927 +0000 UTC m=+66.181907199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret") pod "global-pull-secret-syncer-44z2n" (UID: "63292c14-fa9c-41ff-96ca-2347852d9c34") : object "kube-system"/"original-pull-secret" not registered
Sep 15 13:39:18.932499 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:18.932302    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g podName:ff650f21-bc09-4874-b81b-b942a22d1556 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:50.932285694 +0000 UTC m=+66.181946982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnt4g" (UniqueName: "kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g") pod "network-check-target-jn9zl" (UID: "ff650f21-bc09-4874-b81b-b942a22d1556") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 13:39:19.033061 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:19.033014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:19.033252 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:19.033152    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:19.033252 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:19.033229    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs podName:36a140e3-e410-4d68-adc7-f92983bd75b8 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:51.033206252 +0000 UTC m=+66.282867531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs") pod "network-metrics-daemon-4jknc" (UID: "36a140e3-e410-4d68-adc7-f92983bd75b8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 13:39:19.256527 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:19.256432    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:19.256527 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:19.256462    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:19.256762 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:19.256583    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:19.256762 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:19.256647    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:20.257072 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:20.256872    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:20.257560 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:20.257156    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:20.410030 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:20.409992    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="fbbcd1625d2cb25833e90f3577101682f878e6ef15e9328142783dfa5f62efb3" exitCode=0
Sep 15 13:39:20.410030 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:20.410034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"fbbcd1625d2cb25833e90f3577101682f878e6ef15e9328142783dfa5f62efb3"}
Sep 15 13:39:21.256820 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:21.256782    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:21.257015 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:21.256785    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:21.257015 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:21.256919    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:21.257015 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:21.256959    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:21.415882 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:21.415854    2584 generic.go:356] "Generic (PLEG): container finished" podID="378ecd87-0224-4d80-88f7-b64aee047bb4" containerID="e7e2fa8bd9e5460b29308b43fc9c7c6b86653b3c999c7787406e3a2e4d97433d" exitCode=0
Sep 15 13:39:21.415882 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:21.415895    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerDied","Data":"e7e2fa8bd9e5460b29308b43fc9c7c6b86653b3c999c7787406e3a2e4d97433d"}
Sep 15 13:39:22.256930 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:22.256890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:22.257125 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:22.257012    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:22.421207 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:22.421169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x22n5" event={"ID":"378ecd87-0224-4d80-88f7-b64aee047bb4","Type":"ContainerStarted","Data":"35b19bdde5fe3d13f47fb8e40cc7bf25b85f805239fb2320a5be1cde9efd358d"}
Sep 15 13:39:22.443804 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:22.443758    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x22n5" podStartSLOduration=6.49210044 podStartE2EDuration="37.44374196s" totalImagesPullingTime="30.95164152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:22.443027366 +0000 UTC m=+37.692688660" watchObservedRunningTime="2026-09-15 13:39:22.44374196 +0000 UTC m=+37.693403237"
Sep 15 13:39:23.256810 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:23.256773    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:23.257001 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:23.256884    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:23.257001 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:23.256937    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:23.257109 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:23.257020    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:24.257145 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:24.257109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:24.257514 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:24.257211    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:25.258128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:25.258098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:25.258500 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:25.258187    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:25.258500 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:25.258242    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:25.258500 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:25.258333    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:26.256585 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:26.256545    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:26.256776 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:26.256655    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:27.256915 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:27.256879    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:27.257319 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:27.256991    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:27.257319 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:27.257048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:27.257319 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:27.257183    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:28.256626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:28.256586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:28.256847 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:28.256737    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:29.256508 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:29.256464    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:29.257142 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:29.256585    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:29.257142 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:29.256635    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:29.257142 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:29.256748    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:30.256839 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:30.256796    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:30.257228 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:30.256902    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:31.256987 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:31.256947    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:31.257484 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:31.257063    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:31.257484 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:31.257108    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:31.257484 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:31.257204    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:32.256653 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:32.256614    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:32.256850 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:32.256741    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:33.256972 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.256940    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:33.257420 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.256941    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:33.257420 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:33.257049    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:33.257420 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:33.257156    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:33.690383 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.690347    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jn9zl"]
Sep 15 13:39:33.690553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.690490    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:33.690622 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:33.690598    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:33.693976 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.693948    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44z2n"]
Sep 15 13:39:33.694130 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.694047    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:33.694198 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:33.694150    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:33.694472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.694450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jknc"]
Sep 15 13:39:33.694627 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:33.694611    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:33.694775 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:33.694757    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:35.258860 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:35.258580    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:35.259367 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:35.258644    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:35.259367 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:35.258959    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:35.259367 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:35.258676    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:35.259367 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:35.259034    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:35.259367 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:35.259076    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:37.257413 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.257375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:37.257855 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.257375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:37.257855 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:37.257480    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jknc" podUID="36a140e3-e410-4d68-adc7-f92983bd75b8"
Sep 15 13:39:37.257855 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:37.257575    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jn9zl" podUID="ff650f21-bc09-4874-b81b-b942a22d1556"
Sep 15 13:39:37.257855 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.257390    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:37.257855 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:37.257694    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z2n" podUID="63292c14-fa9c-41ff-96ca-2347852d9c34"
Sep 15 13:39:37.540956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.540879    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeReady"
Sep 15 13:39:37.541094 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.540999    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 13:39:37.589551 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.589521    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qfxf5"]
Sep 15 13:39:37.592333 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.592310    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-brvg5"]
Sep 15 13:39:37.592469 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.592424    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.594874 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.594853    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.595374 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.595355    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 13:39:37.595473 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.595429    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 13:39:37.595535 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.595484    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfkpb\""
Sep 15 13:39:37.597850 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.597830    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mmgq5\""
Sep 15 13:39:37.597973 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.597884    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 13:39:37.598109 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.598084    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 13:39:37.598201 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.598118    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 13:39:37.600500 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.600476    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brvg5"]
Sep 15 13:39:37.603059 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.602684    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfxf5"]
Sep 15 13:39:37.707929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.707897    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"]
Sep 15 13:39:37.710723 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.710699    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"
Sep 15 13:39:37.713909 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.713886    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 15 13:39:37.714059 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.713886    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9d9mx\""
Sep 15 13:39:37.714059 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.713886    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 15 13:39:37.719149 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.719122    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"]
Sep 15 13:39:37.760242 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd47974-6403-4c17-b1fa-2e14af7e1d16-config-volume\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.760242 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760244    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cd47974-6403-4c17-b1fa-2e14af7e1d16-metrics-tls\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.760470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-cert\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.760470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws6hn\" (UniqueName: \"kubernetes.io/projected/0cd47974-6403-4c17-b1fa-2e14af7e1d16-kube-api-access-ws6hn\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.760470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66vlz\" (UniqueName: \"kubernetes.io/projected/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-kube-api-access-66vlz\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.760470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.760391    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd47974-6403-4c17-b1fa-2e14af7e1d16-tmp-dir\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.861711 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd47974-6403-4c17-b1fa-2e14af7e1d16-config-volume\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.861711 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cd47974-6403-4c17-b1fa-2e14af7e1d16-metrics-tls\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.861840 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-cert\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.861908 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws6hn\" (UniqueName: \"kubernetes.io/projected/0cd47974-6403-4c17-b1fa-2e14af7e1d16-kube-api-access-ws6hn\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.861958 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66vlz\" (UniqueName: \"kubernetes.io/projected/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-kube-api-access-66vlz\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.862010 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.861978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd47974-6403-4c17-b1fa-2e14af7e1d16-tmp-dir\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.862057 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.862021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htsnc\" (UniqueName: \"kubernetes.io/projected/f450f250-0148-4040-a42d-e68a6dfab993-kube-api-access-htsnc\") pod \"migrator-8b4d697c5-vswhd\" (UID: \"f450f250-0148-4040-a42d-e68a6dfab993\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"
Sep 15 13:39:37.862249 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.862233    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd47974-6403-4c17-b1fa-2e14af7e1d16-config-volume\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.862359 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.862336    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd47974-6403-4c17-b1fa-2e14af7e1d16-tmp-dir\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.865868 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.865838    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cd47974-6403-4c17-b1fa-2e14af7e1d16-metrics-tls\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.866472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.866454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-cert\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.873045 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.873014    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66vlz\" (UniqueName: \"kubernetes.io/projected/7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd-kube-api-access-66vlz\") pod \"ingress-canary-brvg5\" (UID: \"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd\") " pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.873550 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.873524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws6hn\" (UniqueName: \"kubernetes.io/projected/0cd47974-6403-4c17-b1fa-2e14af7e1d16-kube-api-access-ws6hn\") pod \"dns-default-qfxf5\" (UID: \"0cd47974-6403-4c17-b1fa-2e14af7e1d16\") " pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.889315 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.889280    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gpdc4"]
Sep 15 13:39:37.893429 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.893405    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:37.895647 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.895621    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 13:39:37.895900 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.895886    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jx2vh\""
Sep 15 13:39:37.896170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.896147    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 13:39:37.896258 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.896236    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 13:39:37.896431 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.896418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 13:39:37.903205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.903182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:37.904501 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.904480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gpdc4"]
Sep 15 13:39:37.909081 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.909057    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brvg5"
Sep 15 13:39:37.962562 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.962521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htsnc\" (UniqueName: \"kubernetes.io/projected/f450f250-0148-4040-a42d-e68a6dfab993-kube-api-access-htsnc\") pod \"migrator-8b4d697c5-vswhd\" (UID: \"f450f250-0148-4040-a42d-e68a6dfab993\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"
Sep 15 13:39:37.977612 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:37.977574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htsnc\" (UniqueName: \"kubernetes.io/projected/f450f250-0148-4040-a42d-e68a6dfab993-kube-api-access-htsnc\") pod \"migrator-8b4d697c5-vswhd\" (UID: \"f450f250-0148-4040-a42d-e68a6dfab993\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"
Sep 15 13:39:38.020409 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.020372    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"
Sep 15 13:39:38.062985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.062952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-crio-socket\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.063158 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.063015    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.063158 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.063045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv8b\" (UniqueName: \"kubernetes.io/projected/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-api-access-2dv8b\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.063158 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.063069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.063158 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.063092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-data-volume\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164457 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv8b\" (UniqueName: \"kubernetes.io/projected/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-api-access-2dv8b\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.164539    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-data-volume\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.164613    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:38.66459515 +0000 UTC m=+53.914256425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.164703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-crio-socket\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164967 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.164746    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.164967 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.164807    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:38.664790539 +0000 UTC m=+53.914451823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.164967 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-crio-socket\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.164967 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.164942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-data-volume\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.175241 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.175212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv8b\" (UniqueName: \"kubernetes.io/projected/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-api-access-2dv8b\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.193574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.193399    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brvg5"]
Sep 15 13:39:38.197446 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.196338    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfxf5"]
Sep 15 13:39:38.198157 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:38.198126    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae0c065_cd30_4ab1_98f6_4e0a7bdd41bd.slice/crio-829416d05eb5b09fcbaf122b1af6d4afe80116a03740fbba160cbcb8e052a2f2 WatchSource:0}: Error finding container 829416d05eb5b09fcbaf122b1af6d4afe80116a03740fbba160cbcb8e052a2f2: Status 404 returned error can't find the container with id 829416d05eb5b09fcbaf122b1af6d4afe80116a03740fbba160cbcb8e052a2f2
Sep 15 13:39:38.201094 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:38.201070    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd47974_6403_4c17_b1fa_2e14af7e1d16.slice/crio-2c79cc72746eaa3152cbd88a711a13d3202494af6f305188456b35466fcdd9c4 WatchSource:0}: Error finding container 2c79cc72746eaa3152cbd88a711a13d3202494af6f305188456b35466fcdd9c4: Status 404 returned error can't find the container with id 2c79cc72746eaa3152cbd88a711a13d3202494af6f305188456b35466fcdd9c4
Sep 15 13:39:38.287755 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.287726    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd"]
Sep 15 13:39:38.290627 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:38.290594    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf450f250_0148_4040_a42d_e68a6dfab993.slice/crio-7359356d65d27ad3d55209233d93b2a64495fe5b3a567c60f3261b96e6a08bcf WatchSource:0}: Error finding container 7359356d65d27ad3d55209233d93b2a64495fe5b3a567c60f3261b96e6a08bcf: Status 404 returned error can't find the container with id 7359356d65d27ad3d55209233d93b2a64495fe5b3a567c60f3261b96e6a08bcf
Sep 15 13:39:38.461494 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.461378    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd" event={"ID":"f450f250-0148-4040-a42d-e68a6dfab993","Type":"ContainerStarted","Data":"7359356d65d27ad3d55209233d93b2a64495fe5b3a567c60f3261b96e6a08bcf"}
Sep 15 13:39:38.462472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.462447    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brvg5" event={"ID":"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd","Type":"ContainerStarted","Data":"829416d05eb5b09fcbaf122b1af6d4afe80116a03740fbba160cbcb8e052a2f2"}
Sep 15 13:39:38.463479 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.463457    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfxf5" event={"ID":"0cd47974-6403-4c17-b1fa-2e14af7e1d16","Type":"ContainerStarted","Data":"2c79cc72746eaa3152cbd88a711a13d3202494af6f305188456b35466fcdd9c4"}
Sep 15 13:39:38.669508 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.669469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.669641 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:38.669520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:38.669641 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.669600    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:38.669641 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.669627    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.669781 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.669688    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.669650743 +0000 UTC m=+54.919312014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:38.669781 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:38.669706    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:39.669697316 +0000 UTC m=+54.919358588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:39.260145 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.260110    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:39.261176 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.261147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:39.262790 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.262763    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:39.263412 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.263394    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztmxf\""
Sep 15 13:39:39.263703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.263654    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 13:39:39.264379 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.264359    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 13:39:39.264700 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.264684    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 13:39:39.264931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.264915    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwvrm\""
Sep 15 13:39:39.265360 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.265337    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 13:39:39.677079 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.677045    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:39.677468 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:39.677148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:39.677468 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:39.677210    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:39.677468 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:39.677230    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:39.677468 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:39.677275    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:41.677256103 +0000 UTC m=+56.926917381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:39.677468 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:39.677296    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:41.677283642 +0000 UTC m=+56.926944919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:40.472216 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:40.472177    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd" event={"ID":"f450f250-0148-4040-a42d-e68a6dfab993","Type":"ContainerStarted","Data":"4e9425549774eb0ffecc42194a2bf505a9d17dce1469e0a1370704aa733316c2"}
Sep 15 13:39:40.472488 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:40.472246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd" event={"ID":"f450f250-0148-4040-a42d-e68a6dfab993","Type":"ContainerStarted","Data":"e68339aea955c439fa53622e0cbe938d9c4f3262a0e98c90f89e26c699dfedb4"}
Sep 15 13:39:40.488464 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:40.488413    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vswhd" podStartSLOduration=2.203314012 podStartE2EDuration="3.488389715s" totalImagesPullingTime="1.285075703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:40.486991666 +0000 UTC m=+55.736652961" watchObservedRunningTime="2026-09-15 13:39:40.488389715 +0000 UTC m=+55.738051010"
Sep 15 13:39:40.665836 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:40.665800    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6q7cq_30a14812-e5b3-44ca-838c-9cca83be1f8d/dns-node-resolver/0.log"
Sep 15 13:39:41.386234 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.386198    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-m7x54"]
Sep 15 13:39:41.389290 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.389265    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:39:41.389559 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.389533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zdx\" (UniqueName: \"kubernetes.io/projected/4ea37fff-b707-43f1-b9f2-dd58647f1776-kube-api-access-74zdx\") pod \"downloads-76f99584f4-m7x54\" (UID: \"4ea37fff-b707-43f1-b9f2-dd58647f1776\") " pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:39:41.391886 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.391867    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-52tms\""
Sep 15 13:39:41.392154 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.392085    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 13:39:41.392154 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.392105    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 13:39:41.399036 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.399010    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-m7x54"]
Sep 15 13:39:41.475975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.475942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brvg5" event={"ID":"7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd","Type":"ContainerStarted","Data":"bf518ee8cd882225e9f252e26b0e3b0928171b287d77d4d86392fb39fe961828"}
Sep 15 13:39:41.477732 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.477700    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfxf5" event={"ID":"0cd47974-6403-4c17-b1fa-2e14af7e1d16","Type":"ContainerStarted","Data":"19ef2a7d3ba4e78530b255acb8d344c21dad19f0a324632228906064abce8cce"}
Sep 15 13:39:41.477850 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.477749    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfxf5" event={"ID":"0cd47974-6403-4c17-b1fa-2e14af7e1d16","Type":"ContainerStarted","Data":"a021e9ba55836572a03b7a4d04e5d6a345ab4fcff3c7e38854142be4f249a8d1"}
Sep 15 13:39:41.490725 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.490693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zdx\" (UniqueName: \"kubernetes.io/projected/4ea37fff-b707-43f1-b9f2-dd58647f1776-kube-api-access-74zdx\") pod \"downloads-76f99584f4-m7x54\" (UID: \"4ea37fff-b707-43f1-b9f2-dd58647f1776\") " pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:39:41.492791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.492747    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-brvg5" podStartSLOduration=1.688052668 podStartE2EDuration="4.492732466s" totalImagesPullingTime="2.804679798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:41.491457034 +0000 UTC m=+56.741118328" watchObservedRunningTime="2026-09-15 13:39:41.492732466 +0000 UTC m=+56.742393760"
Sep 15 13:39:41.511877 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.511844    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zdx\" (UniqueName: \"kubernetes.io/projected/4ea37fff-b707-43f1-b9f2-dd58647f1776-kube-api-access-74zdx\") pod \"downloads-76f99584f4-m7x54\" (UID: \"4ea37fff-b707-43f1-b9f2-dd58647f1776\") " pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:39:41.518353 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.518309    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qfxf5" podStartSLOduration=1.72091936 podStartE2EDuration="4.518295119s" totalImagesPullingTime="2.797375759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:41.517251647 +0000 UTC m=+56.766912962" watchObservedRunningTime="2026-09-15 13:39:41.518295119 +0000 UTC m=+56.767956403"
Sep 15 13:39:41.527587 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.527559    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"]
Sep 15 13:39:41.530607 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.530587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.532965 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.532943    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 13:39:41.533084 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.532963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 13:39:41.533084 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.533005    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cd9cr\""
Sep 15 13:39:41.533394 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.533375    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 13:39:41.533484 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.533375    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 13:39:41.533539 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.533514    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 13:39:41.542191 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.542170    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"]
Sep 15 13:39:41.591056 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.591007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.591252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.591089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.591252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.591119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c020e4-89b9-4506-a2e4-5898e889fbb6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.591252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.591145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzk5j\" (UniqueName: \"kubernetes.io/projected/d5c020e4-89b9-4506-a2e4-5898e889fbb6-kube-api-access-dzk5j\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.691898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.691809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.691898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.691859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:41.691898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.691889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.691915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c020e4-89b9-4506-a2e4-5898e889fbb6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.691950    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.691980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk5j\" (UniqueName: \"kubernetes.io/projected/d5c020e4-89b9-4506-a2e4-5898e889fbb6-kube-api-access-dzk5j\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.691962    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.692025    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls podName:d5c020e4-89b9-4506-a2e4-5898e889fbb6 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:42.192007754 +0000 UTC m=+57.441669030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-9z4dj" (UID: "d5c020e4-89b9-4506-a2e4-5898e889fbb6") : secret "prometheus-operator-tls" not found
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.692131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:41.692177 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.692158    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:45.692141633 +0000 UTC m=+60.941802921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:41.692436 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.692207    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:41.692436 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:41.692249    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:45.692234889 +0000 UTC m=+60.941896164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:41.692625 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.692607    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c020e4-89b9-4506-a2e4-5898e889fbb6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.694298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.694279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.698095 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.698074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:39:41.700462 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.700440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzk5j\" (UniqueName: \"kubernetes.io/projected/d5c020e4-89b9-4506-a2e4-5898e889fbb6-kube-api-access-dzk5j\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:41.967462 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:41.967387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-m7x54"]
Sep 15 13:39:41.971456 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:41.971424    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea37fff_b707_43f1_b9f2_dd58647f1776.slice/crio-e8f3b5a86dcf996a5e97398ed068d75bfa51d8c981ddfc09be424c7cae954ab3 WatchSource:0}: Error finding container e8f3b5a86dcf996a5e97398ed068d75bfa51d8c981ddfc09be424c7cae954ab3: Status 404 returned error can't find the container with id e8f3b5a86dcf996a5e97398ed068d75bfa51d8c981ddfc09be424c7cae954ab3
Sep 15 13:39:42.066038 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.066011    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zt9tn_6b682f9b-c411-41c1-96a0-84d00a22b000/node-ca/0.log"
Sep 15 13:39:42.194936 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.194894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:42.197248 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.197217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c020e4-89b9-4506-a2e4-5898e889fbb6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9z4dj\" (UID: \"d5c020e4-89b9-4506-a2e4-5898e889fbb6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:42.441333 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.441295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"
Sep 15 13:39:42.464320 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.464292    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brvg5_7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd/serve-healthcheck-canary/0.log"
Sep 15 13:39:42.481995 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.481966    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-m7x54" event={"ID":"4ea37fff-b707-43f1-b9f2-dd58647f1776","Type":"ContainerStarted","Data":"e8f3b5a86dcf996a5e97398ed068d75bfa51d8c981ddfc09be424c7cae954ab3"}
Sep 15 13:39:42.482282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.482261    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:42.745166 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:42.745085    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj"]
Sep 15 13:39:42.747987 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:42.747960    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c020e4_89b9_4506_a2e4_5898e889fbb6.slice/crio-ea040b82a023161ba8b18968db335690c9bd97fce9f230c6ecc5f066db48d206 WatchSource:0}: Error finding container ea040b82a023161ba8b18968db335690c9bd97fce9f230c6ecc5f066db48d206: Status 404 returned error can't find the container with id ea040b82a023161ba8b18968db335690c9bd97fce9f230c6ecc5f066db48d206
Sep 15 13:39:43.065206 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:43.065133    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vswhd_f450f250-0148-4040-a42d-e68a6dfab993/migrator/0.log"
Sep 15 13:39:43.267616 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:43.267579    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vswhd_f450f250-0148-4040-a42d-e68a6dfab993/graceful-termination/0.log"
Sep 15 13:39:43.486336 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:43.486300    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj" event={"ID":"d5c020e4-89b9-4506-a2e4-5898e889fbb6","Type":"ContainerStarted","Data":"ea040b82a023161ba8b18968db335690c9bd97fce9f230c6ecc5f066db48d206"}
Sep 15 13:39:44.496829 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:44.496742    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj" event={"ID":"d5c020e4-89b9-4506-a2e4-5898e889fbb6","Type":"ContainerStarted","Data":"08fadd7835bbba354f9b90f4286d05b27b99773a0e003ec25f099e71edd28b7f"}
Sep 15 13:39:44.497260 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:44.496850    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj" event={"ID":"d5c020e4-89b9-4506-a2e4-5898e889fbb6","Type":"ContainerStarted","Data":"246419ddc6b15fcd0d7b2cb2e7d50b254094fd8dc47992b4d593c3cc5397571f"}
Sep 15 13:39:44.516759 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:44.516699    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9z4dj" podStartSLOduration=2.02903471 podStartE2EDuration="3.51668314s" totalImagesPullingTime="1.48764843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:44.5154248 +0000 UTC m=+59.765086095" watchObservedRunningTime="2026-09-15 13:39:44.51668314 +0000 UTC m=+59.766344432"
Sep 15 13:39:45.407412 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:45.407378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzzr"
Sep 15 13:39:45.722053 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:45.721960    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:45.722053 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:45.722021    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:45.722473 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:45.722095    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 13:39:45.722473 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:45.722125    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:45.722473 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:45.722174    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:53.722155137 +0000 UTC m=+68.971816410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : configmap "kube-rbac-proxy" not found
Sep 15 13:39:45.722473 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:45.722191    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls podName:aab5a1f9-daf6-431a-8e71-83be5dcd68e0 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:53.722184704 +0000 UTC m=+68.971845975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gpdc4" (UID: "aab5a1f9-daf6-431a-8e71-83be5dcd68e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 13:39:46.935643 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.935606    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"]
Sep 15 13:39:46.940353 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.940325    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:46.943379 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.943349    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jcpvp\""
Sep 15 13:39:46.943561 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.943349    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 13:39:46.943561 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.943355    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 13:39:46.956896 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.956837    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"]
Sep 15 13:39:46.957905 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.957880    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"]
Sep 15 13:39:46.960959 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.960936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:46.963266 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.963245    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 13:39:46.963522 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.963499    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hnhcp\""
Sep 15 13:39:46.963634 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.963558    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 13:39:46.963634 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.963565    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 13:39:46.975727 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.975632    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"]
Sep 15 13:39:46.986635 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.986604    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dc27n"]
Sep 15 13:39:46.989705 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.989659    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:46.992073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.992048    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 13:39:46.992212 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.992088    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cz7pd\""
Sep 15 13:39:46.992292 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.992263    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 13:39:46.993092 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:46.993073    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 13:39:47.030729 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkf9t\" (UniqueName: \"kubernetes.io/projected/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-api-access-rkf9t\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.030910 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.030910 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.030910 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-root\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031075 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030912    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031075 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030933    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-textfile\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031075 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.030955    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.031075 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-wtmp\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031167    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrp7\" (UniqueName: \"kubernetes.io/projected/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-kube-api-access-ffrp7\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-sys\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031244    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-metrics-client-ca\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031282 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.031739 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2mr\" (UniqueName: \"kubernetes.io/projected/ea55a7f8-1f24-457f-a917-8fc5ff151094-kube-api-access-6g2mr\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.031739 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.031425    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a24322c1-3065-4507-8ee1-7088d0e8f887-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.132805 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.132768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkf9t\" (UniqueName: \"kubernetes.io/projected/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-api-access-rkf9t\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.132805 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.132806    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.133042 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.132837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.133042 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:47.133005    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 15 13:39:47.133134 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:47.133055    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls podName:a24322c1-3065-4507-8ee1-7088d0e8f887 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:47.63304037 +0000 UTC m=+62.882701655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-5zljj" (UID: "a24322c1-3065-4507-8ee1-7088d0e8f887") : secret "kube-state-metrics-tls" not found
Sep 15 13:39:47.133134 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-root\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-textfile\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133175    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-root\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-wtmp\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133434    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133447 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133439    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-textfile\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrp7\" (UniqueName: \"kubernetes.io/projected/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-kube-api-access-ffrp7\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-sys\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133523    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-metrics-client-ca\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.133833 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:47.133863    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:47.133909    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls podName:ea55a7f8-1f24-457f-a917-8fc5ff151094 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:47.633893269 +0000 UTC m=+62.883554557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls") pod "node-exporter-dc27n" (UID: "ea55a7f8-1f24-457f-a917-8fc5ff151094") : secret "node-exporter-tls" not found
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-wtmp\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.133955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea55a7f8-1f24-457f-a917-8fc5ff151094-sys\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2mr\" (UniqueName: \"kubernetes.io/projected/ea55a7f8-1f24-457f-a917-8fc5ff151094-kube-api-access-6g2mr\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a24322c1-3065-4507-8ee1-7088d0e8f887-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.134170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea55a7f8-1f24-457f-a917-8fc5ff151094-metrics-client-ca\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.134486 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a24322c1-3065-4507-8ee1-7088d0e8f887-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.134718 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.134694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.136008 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.135978    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.136104 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.136046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.136217 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.136200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.136286 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.136265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.143026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.142998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrp7\" (UniqueName: \"kubernetes.io/projected/9a7e1f55-9589-45ee-bfe8-8791e26ac7b0-kube-api-access-ffrp7\") pod \"openshift-state-metrics-67dcf8c979-nckf8\" (UID: \"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.144094 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.144067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkf9t\" (UniqueName: \"kubernetes.io/projected/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-api-access-rkf9t\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.148421 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.148401    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2mr\" (UniqueName: \"kubernetes.io/projected/ea55a7f8-1f24-457f-a917-8fc5ff151094-kube-api-access-6g2mr\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.251634 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.251549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"
Sep 15 13:39:47.530963 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.530890    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8"]
Sep 15 13:39:47.533614 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:47.533588    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7e1f55_9589_45ee_bfe8_8791e26ac7b0.slice/crio-592cc1cdd2808e497f909274e63569d67da4765440afa9261162e10337666523 WatchSource:0}: Error finding container 592cc1cdd2808e497f909274e63569d67da4765440afa9261162e10337666523: Status 404 returned error can't find the container with id 592cc1cdd2808e497f909274e63569d67da4765440afa9261162e10337666523
Sep 15 13:39:47.638844 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.638808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.638985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.638937    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.641689 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.641624    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea55a7f8-1f24-457f-a917-8fc5ff151094-node-exporter-tls\") pod \"node-exporter-dc27n\" (UID: \"ea55a7f8-1f24-457f-a917-8fc5ff151094\") " pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.641802 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.641783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a24322c1-3065-4507-8ee1-7088d0e8f887-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5zljj\" (UID: \"a24322c1-3065-4507-8ee1-7088d0e8f887\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.869810 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.869722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"
Sep 15 13:39:47.898898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:47.898865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dc27n"
Sep 15 13:39:47.912031 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:47.911992    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea55a7f8_1f24_457f_a917_8fc5ff151094.slice/crio-66c693e0ce637d0912366a7052c10777e144e6c8649d7d23d2fd9cc41870fad3 WatchSource:0}: Error finding container 66c693e0ce637d0912366a7052c10777e144e6c8649d7d23d2fd9cc41870fad3: Status 404 returned error can't find the container with id 66c693e0ce637d0912366a7052c10777e144e6c8649d7d23d2fd9cc41870fad3
Sep 15 13:39:48.045067 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.045037    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:39:48.050264 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.050235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.052990 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.052957    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gwp2k\""
Sep 15 13:39:48.053120 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.052991    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 13:39:48.053120 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.052994    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 13:39:48.053386 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053367    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 13:39:48.053483 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053372    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 13:39:48.053713 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053696    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 13:39:48.053713 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053704    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 13:39:48.053853 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053739    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 13:39:48.053853 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.053833    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 13:39:48.054781 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.054761    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 13:39:48.069548 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.069485    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:39:48.143091 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143274 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143274 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143387 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143387 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143387 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143380    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143530 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143530 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143530 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv7qh\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143567    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.143692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.143618    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.148001 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.147972    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj"]
Sep 15 13:39:48.152222 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:48.152189    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24322c1_3065_4507_8ee1_7088d0e8f887.slice/crio-69737d3e32c07e280e27030779dd03c4a8da84acd2f6a69363a269c736a910b4 WatchSource:0}: Error finding container 69737d3e32c07e280e27030779dd03c4a8da84acd2f6a69363a269c736a910b4: Status 404 returned error can't find the container with id 69737d3e32c07e280e27030779dd03c4a8da84acd2f6a69363a269c736a910b4
Sep 15 13:39:48.244925 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.244853    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.244925 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.244902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.244925 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.244930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.244958    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv7qh\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245072    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245504 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245504 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.245504 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.245351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.246808 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:48.246780    2584 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 15 13:39:48.246942 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:48.246867    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls podName:35aba45e-737d-4ebc-867f-b9921f40f14d nodeName:}" failed. No retries permitted until 2026-09-15 13:39:48.74684827 +0000 UTC m=+63.996509542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d") : secret "alertmanager-main-tls" not found
Sep 15 13:39:48.247905 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.247807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.248586 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.248564    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.248714 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.248609    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.248852 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.248822    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.249546 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.249517    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.249906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.249884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.250345 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.250317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.251453 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.251410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.251578 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.251558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.252206 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.252164    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.252517 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.252498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.254335 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.254313    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv7qh\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.514070 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.513976    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj" event={"ID":"a24322c1-3065-4507-8ee1-7088d0e8f887","Type":"ContainerStarted","Data":"69737d3e32c07e280e27030779dd03c4a8da84acd2f6a69363a269c736a910b4"}
Sep 15 13:39:48.516558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.516518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8" event={"ID":"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0","Type":"ContainerStarted","Data":"55554403faacd6a0ccfdc61eef7c7a96ffe2404f88085ed785348cc8746905b8"}
Sep 15 13:39:48.516724 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.516591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8" event={"ID":"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0","Type":"ContainerStarted","Data":"5615d43800a1e571eab436f9d84584d7f6e84aebbd16c811f8bfecdabb4f25cf"}
Sep 15 13:39:48.516724 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.516621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8" event={"ID":"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0","Type":"ContainerStarted","Data":"592cc1cdd2808e497f909274e63569d67da4765440afa9261162e10337666523"}
Sep 15 13:39:48.517974 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.517944    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc27n" event={"ID":"ea55a7f8-1f24-457f-a917-8fc5ff151094","Type":"ContainerStarted","Data":"66c693e0ce637d0912366a7052c10777e144e6c8649d7d23d2fd9cc41870fad3"}
Sep 15 13:39:48.749266 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.749230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.751883 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.751847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:48.961928 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:48.961888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:39:49.254996 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.254859    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:39:49.261531 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:49.261480    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35aba45e_737d_4ebc_867f_b9921f40f14d.slice/crio-0eac56699c7e6141265c1abddf8d55c7c5e8066eebd9e4b6a66ae8482206d61d WatchSource:0}: Error finding container 0eac56699c7e6141265c1abddf8d55c7c5e8066eebd9e4b6a66ae8482206d61d: Status 404 returned error can't find the container with id 0eac56699c7e6141265c1abddf8d55c7c5e8066eebd9e4b6a66ae8482206d61d
Sep 15 13:39:49.524422 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.524383    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"0eac56699c7e6141265c1abddf8d55c7c5e8066eebd9e4b6a66ae8482206d61d"}
Sep 15 13:39:49.527329 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.527297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8" event={"ID":"9a7e1f55-9589-45ee-bfe8-8791e26ac7b0","Type":"ContainerStarted","Data":"0270970e9b7ebeec2a96f687c1e5d62d05503a2a3d23fc90168a5e4e7b72514f"}
Sep 15 13:39:49.546224 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.546172    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-nckf8" podStartSLOduration=2.4465238 podStartE2EDuration="3.546151132s" totalImagesPullingTime="1.099627332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:49.545328653 +0000 UTC m=+64.794989948" watchObservedRunningTime="2026-09-15 13:39:49.546151132 +0000 UTC m=+64.795812423"
Sep 15 13:39:49.956262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.956222    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"]
Sep 15 13:39:49.973546 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.973514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:49.974782 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.974687    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"]
Sep 15 13:39:49.976693 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.976602    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a3g8jbq02qj8j\""
Sep 15 13:39:49.976830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.976759    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 13:39:49.976981 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.976910    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 13:39:49.977086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.976627    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 13:39:49.977086 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.977017    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 13:39:49.977193 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.977110    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 13:39:49.977330 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:49.977303    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9fqlt\""
Sep 15 13:39:50.061852 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.061820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062022 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.061868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145c74f9-8550-45e4-bfa3-e4a7f8812246-metrics-client-ca\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062022 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.061929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062160 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.062030    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062160 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.062075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062160 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.062109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062265 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.062180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-grpc-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.062265 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.062202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkl7\" (UniqueName: \"kubernetes.io/projected/145c74f9-8550-45e4-bfa3-e4a7f8812246-kube-api-access-srkl7\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163350 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163515 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-grpc-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163515 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163413    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srkl7\" (UniqueName: \"kubernetes.io/projected/145c74f9-8550-45e4-bfa3-e4a7f8812246-kube-api-access-srkl7\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163625 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163728 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145c74f9-8550-45e4-bfa3-e4a7f8812246-metrics-client-ca\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163809 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.163959 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.163922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.164847 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.164761    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145c74f9-8550-45e4-bfa3-e4a7f8812246-metrics-client-ca\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.166583 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.166532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.166846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.166799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-grpc-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.168244 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.168215    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.168428 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.168402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.169306 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.169276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-tls\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.169306 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.169287    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/145c74f9-8550-45e4-bfa3-e4a7f8812246-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.172403 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.172378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkl7\" (UniqueName: \"kubernetes.io/projected/145c74f9-8550-45e4-bfa3-e4a7f8812246-kube-api-access-srkl7\") pod \"thanos-querier-7fbbb464fb-n4ld5\" (UID: \"145c74f9-8550-45e4-bfa3-e4a7f8812246\") " pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.285306 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.285270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:39:50.537534 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.537440    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj" event={"ID":"a24322c1-3065-4507-8ee1-7088d0e8f887","Type":"ContainerStarted","Data":"27e592624c867541f9c4dc1fd6b676e51c3ed2f9bd744fc700bd37ced152569e"}
Sep 15 13:39:50.609536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.608880    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"]
Sep 15 13:39:50.921977 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:50.921941    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145c74f9_8550_45e4_bfa3_e4a7f8812246.slice/crio-3583142a754df56e0981b036ef77509cd5e0b513ca28200b7824a4af38dbcd5f WatchSource:0}: Error finding container 3583142a754df56e0981b036ef77509cd5e0b513ca28200b7824a4af38dbcd5f: Status 404 returned error can't find the container with id 3583142a754df56e0981b036ef77509cd5e0b513ca28200b7824a4af38dbcd5f
Sep 15 13:39:50.973526 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.973494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:50.973703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.973538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:50.976109 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.976058    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 13:39:50.976241 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.976138    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 13:39:50.986810 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.986761    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 13:39:50.987049 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.987023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63292c14-fa9c-41ff-96ca-2347852d9c34-original-pull-secret\") pod \"global-pull-secret-syncer-44z2n\" (UID: \"63292c14-fa9c-41ff-96ca-2347852d9c34\") " pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:50.997524 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.997496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z2n"
Sep 15 13:39:50.998205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:50.998181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnt4g\" (UniqueName: \"kubernetes.io/projected/ff650f21-bc09-4874-b81b-b942a22d1556-kube-api-access-nnt4g\") pod \"network-check-target-jn9zl\" (UID: \"ff650f21-bc09-4874-b81b-b942a22d1556\") " pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:51.074335 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.074292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:51.076999 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.076977    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 13:39:51.087774 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.087745    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a140e3-e410-4d68-adc7-f92983bd75b8-metrics-certs\") pod \"network-metrics-daemon-4jknc\" (UID: \"36a140e3-e410-4d68-adc7-f92983bd75b8\") " pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:51.263179 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.263155    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fb557ff7b-wh79h"]
Sep 15 13:39:51.268435 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.267610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.294913    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d9rhf\""
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.295773    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2n9502f7q4nbj\""
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.296999    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.297281    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.297658    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 13:39:51.300684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.298134    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 13:39:51.306703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.303029    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwvrm\""
Sep 15 13:39:51.306703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.304268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jknc"
Sep 15 13:39:51.306703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.306486    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztmxf\""
Sep 15 13:39:51.308756 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.308729    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fb557ff7b-wh79h"]
Sep 15 13:39:51.313878 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.313841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:39:51.405698 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.405551    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-client-certs\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.405698 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.405598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34cf86ae-8ff2-4648-a277-535c017af72b-audit-log\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.405698 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.405627    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-metrics-server-audit-profiles\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.406734 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.406475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-client-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.407358 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.406901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwks6\" (UniqueName: \"kubernetes.io/projected/34cf86ae-8ff2-4648-a277-535c017af72b-kube-api-access-cwks6\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.407702 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.407575    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-tls\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.407702 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.407619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-tls\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508819    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-client-certs\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34cf86ae-8ff2-4648-a277-535c017af72b-audit-log\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-metrics-server-audit-profiles\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-client-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.508975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.508967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwks6\" (UniqueName: \"kubernetes.io/projected/34cf86ae-8ff2-4648-a277-535c017af72b-kube-api-access-cwks6\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.509380 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.509328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34cf86ae-8ff2-4648-a277-535c017af72b-audit-log\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.509865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.509803    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.510767 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.510717    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34cf86ae-8ff2-4648-a277-535c017af72b-metrics-server-audit-profiles\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.512553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.512526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-client-ca-bundle\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.512687 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.512643    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-client-certs\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.512756 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.512694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34cf86ae-8ff2-4648-a277-535c017af72b-secret-metrics-server-tls\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.518272 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.518252    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwks6\" (UniqueName: \"kubernetes.io/projected/34cf86ae-8ff2-4648-a277-535c017af72b-kube-api-access-cwks6\") pod \"metrics-server-fb557ff7b-wh79h\" (UID: \"34cf86ae-8ff2-4648-a277-535c017af72b\") " pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.543100 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.543058    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38" exitCode=0
Sep 15 13:39:51.543245 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.543139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38"}
Sep 15 13:39:51.544603 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.544580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"3583142a754df56e0981b036ef77509cd5e0b513ca28200b7824a4af38dbcd5f"}
Sep 15 13:39:51.546414 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.546289    2584 generic.go:356] "Generic (PLEG): container finished" podID="ea55a7f8-1f24-457f-a917-8fc5ff151094" containerID="05fbbe3146e330cb1e2a31d610778f322cf62a0afff01e495aac67ee83ea2e7e" exitCode=0
Sep 15 13:39:51.546414 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.546393    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc27n" event={"ID":"ea55a7f8-1f24-457f-a917-8fc5ff151094","Type":"ContainerDied","Data":"05fbbe3146e330cb1e2a31d610778f322cf62a0afff01e495aac67ee83ea2e7e"}
Sep 15 13:39:51.549355 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.549334    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj" event={"ID":"a24322c1-3065-4507-8ee1-7088d0e8f887","Type":"ContainerStarted","Data":"2cc2c905425260e38ef25c30e4cb334c7f4f6f799e1750c2ead5f347d79e0e87"}
Sep 15 13:39:51.549494 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.549384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj" event={"ID":"a24322c1-3065-4507-8ee1-7088d0e8f887","Type":"ContainerStarted","Data":"2dd2eff9d2cd76a16eb97b6c17beb681a4ae0dbaa2e49f9a5d33a3e247d7651e"}
Sep 15 13:39:51.619951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.619924    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44z2n"]
Sep 15 13:39:51.625357 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:51.625318    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63292c14_fa9c_41ff_96ca_2347852d9c34.slice/crio-c45d951d65792fb75616207ed7799cc03b7d6d2be44fb92e3fa4377f996961ba WatchSource:0}: Error finding container c45d951d65792fb75616207ed7799cc03b7d6d2be44fb92e3fa4377f996961ba: Status 404 returned error can't find the container with id c45d951d65792fb75616207ed7799cc03b7d6d2be44fb92e3fa4377f996961ba
Sep 15 13:39:51.625653 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.625627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jknc"]
Sep 15 13:39:51.628542 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:51.628517    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a140e3_e410_4d68_adc7_f92983bd75b8.slice/crio-2a630d49741317aebec028e49d1645afe7238ad2c75875248d872ae3638ba028 WatchSource:0}: Error finding container 2a630d49741317aebec028e49d1645afe7238ad2c75875248d872ae3638ba028: Status 404 returned error can't find the container with id 2a630d49741317aebec028e49d1645afe7238ad2c75875248d872ae3638ba028
Sep 15 13:39:51.643015 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.642958    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5zljj" podStartSLOduration=3.544664095 podStartE2EDuration="5.642934466s" totalImagesPullingTime="2.098270371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:51.642249224 +0000 UTC m=+66.891910545" watchObservedRunningTime="2026-09-15 13:39:51.642934466 +0000 UTC m=+66.892595763"
Sep 15 13:39:51.649889 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.649803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jn9zl"]
Sep 15 13:39:51.651165 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.651070    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:39:51.653131 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:51.652981    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff650f21_bc09_4874_b81b_b942a22d1556.slice/crio-43ab4998b3de8763955f9b0f81ea816eb352e44685c7565ad23503fa00e6dbe8 WatchSource:0}: Error finding container 43ab4998b3de8763955f9b0f81ea816eb352e44685c7565ad23503fa00e6dbe8: Status 404 returned error can't find the container with id 43ab4998b3de8763955f9b0f81ea816eb352e44685c7565ad23503fa00e6dbe8
Sep 15 13:39:51.694237 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.694207    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:39:51.698338 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.698081    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.701027    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.701270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.701456    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.701654    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pw8rk\""
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.702061    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 13:39:51.702364 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.702243    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 13:39:51.711320 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.711291    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:39:51.717924 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.716552    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"]
Sep 15 13:39:51.720415 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.720394    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.723179 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.723161    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2jnnx\""
Sep 15 13:39:51.723449 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.723353    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 13:39:51.735511 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.735481    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"]
Sep 15 13:39:51.812659 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.812846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812701    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.812846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812733    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.812846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.812846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.813103 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rgx\" (UniqueName: \"kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.813103 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812898    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v4cg\" (UniqueName: \"kubernetes.io/projected/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-kube-api-access-9v4cg\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.813103 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.812982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.914426 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.913926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.914426 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.913991    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914426 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914426 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:51.914093    2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 13:39:51.914426 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:39:51.914159    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert podName:5f5d01f0-cc4f-48e3-b71d-b68c04b336c7 nodeName:}" failed. No retries permitted until 2026-09-15 13:39:52.414139162 +0000 UTC m=+67.663800448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-zbz8k" (UID: "5f5d01f0-cc4f-48e3-b71d-b68c04b336c7") : secret "monitoring-plugin-cert" not found
Sep 15 13:39:51.914871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75rgx\" (UniqueName: \"kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.914871 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.914732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v4cg\" (UniqueName: \"kubernetes.io/projected/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-kube-api-access-9v4cg\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.918819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.917009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.918819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.917171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.918819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.917551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.918819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.917709    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.918819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.917912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.935545 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.935514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v4cg\" (UniqueName: \"kubernetes.io/projected/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-kube-api-access-9v4cg\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:51.935733 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.935513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rgx\" (UniqueName: \"kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx\") pod \"console-c79d9c677-gmgjc\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") " pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:51.964615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:51.964584    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fb557ff7b-wh79h"]
Sep 15 13:39:51.967702 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:51.967657    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cf86ae_8ff2_4648_a277_535c017af72b.slice/crio-058647925fc6f005e28f4212c2f93d21d7f238a99ec895cb36d72dddfd45aec9 WatchSource:0}: Error finding container 058647925fc6f005e28f4212c2f93d21d7f238a99ec895cb36d72dddfd45aec9: Status 404 returned error can't find the container with id 058647925fc6f005e28f4212c2f93d21d7f238a99ec895cb36d72dddfd45aec9
Sep 15 13:39:52.016013 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.015789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:39:52.311744 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.311707    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:39:52.426080 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.426040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:52.436371 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.436302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f5d01f0-cc4f-48e3-b71d-b68c04b336c7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zbz8k\" (UID: \"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:52.488549 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.488514    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qfxf5"
Sep 15 13:39:52.561132 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.561027    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jn9zl" event={"ID":"ff650f21-bc09-4874-b81b-b942a22d1556","Type":"ContainerStarted","Data":"43ab4998b3de8763955f9b0f81ea816eb352e44685c7565ad23503fa00e6dbe8"}
Sep 15 13:39:52.570385 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.570286    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jknc" event={"ID":"36a140e3-e410-4d68-adc7-f92983bd75b8","Type":"ContainerStarted","Data":"2a630d49741317aebec028e49d1645afe7238ad2c75875248d872ae3638ba028"}
Sep 15 13:39:52.576329 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.576234    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79d9c677-gmgjc" event={"ID":"42c78a95-4adf-4f80-b78c-a35c6ace6175","Type":"ContainerStarted","Data":"98eba216caec82974648671bde74e9de289ad7ffc090dfcd19f5437e3bc01c46"}
Sep 15 13:39:52.580076 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.579982    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h" event={"ID":"34cf86ae-8ff2-4648-a277-535c017af72b","Type":"ContainerStarted","Data":"058647925fc6f005e28f4212c2f93d21d7f238a99ec895cb36d72dddfd45aec9"}
Sep 15 13:39:52.583172 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.583089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44z2n" event={"ID":"63292c14-fa9c-41ff-96ca-2347852d9c34","Type":"ContainerStarted","Data":"c45d951d65792fb75616207ed7799cc03b7d6d2be44fb92e3fa4377f996961ba"}
Sep 15 13:39:52.590628 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.590591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc27n" event={"ID":"ea55a7f8-1f24-457f-a917-8fc5ff151094","Type":"ContainerStarted","Data":"3c831f780ab6bbf3191a668076aee2675ab4a39b480cdd30225e594dd6672cbb"}
Sep 15 13:39:52.590796 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.590657    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc27n" event={"ID":"ea55a7f8-1f24-457f-a917-8fc5ff151094","Type":"ContainerStarted","Data":"2fa0e0f7cd1b9f36421449bf026840a21a60f91627ece1f290ddf8d1decdbb08"}
Sep 15 13:39:52.637990 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.637732    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:39:52.957929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.957078    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dc27n" podStartSLOduration=3.505227582 podStartE2EDuration="6.957056187s" totalImagesPullingTime="3.373635446s" totalInitContainerRuntime="78.193159ms" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:52.613303512 +0000 UTC m=+67.862964834" watchObservedRunningTime="2026-09-15 13:39:52.957056187 +0000 UTC m=+68.206717482"
Sep 15 13:39:52.957929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:52.957840    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"]
Sep 15 13:39:53.155023 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.154988    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:39:53.164335 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.164300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.169222    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.169481    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.169788    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.170290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.170359    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.170538    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c5e9bbg2i89n7\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.170819    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 13:39:53.171034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.170866    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 13:39:53.172180 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.171875    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 13:39:53.172180 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.172070    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 13:39:53.172403 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.172242    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 13:39:53.176016 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.175972    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 13:39:53.177764 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.176539    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bz5bd\""
Sep 15 13:39:53.177764 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.177012    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 13:39:53.178741 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.178545    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 13:39:53.180525 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.180501    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 13:39:53.184558 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.183782    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.238896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.238950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxh6p\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239091    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239457    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.239842 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.240918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.240918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.240918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.240918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.239645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxh6p\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.341955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342111    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.343754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342163    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.344978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.344978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.344978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.342261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.344978 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.343565    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.346497 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.345825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.346497 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.345887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.347136 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.346820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.349261 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.349234    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.349845 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.349820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.350247 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.350225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.355153 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.355090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.355821 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.355584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.355821 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.355777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.356884 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.356860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.357787 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.357744    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.360028 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.359959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.363129 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.363052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.365011 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.363257    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.365011 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.363390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.365011 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.364015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.365224 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.365204    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.372373 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.372334    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.383465 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.383427    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxh6p\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p\") pod \"prometheus-k8s-0\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.489088 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.488987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:39:53.756175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.754640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:53.756175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.754731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:53.757579 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.757525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:53.759786 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.759757    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aab5a1f9-daf6-431a-8e71-83be5dcd68e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gpdc4\" (UID: \"aab5a1f9-daf6-431a-8e71-83be5dcd68e0\") " pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:53.807218 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.806925    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jx2vh\""
Sep 15 13:39:53.817206 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:53.814201    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gpdc4"
Sep 15 13:39:54.039098 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:39:54.039016    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5d01f0_cc4f_48e3_b71d_b68c04b336c7.slice/crio-a7393c5fea15f34b8cc4f4454f7a30befde6517959c3f9671b7b541f58d2a2fe WatchSource:0}: Error finding container a7393c5fea15f34b8cc4f4454f7a30befde6517959c3f9671b7b541f58d2a2fe: Status 404 returned error can't find the container with id a7393c5fea15f34b8cc4f4454f7a30befde6517959c3f9671b7b541f58d2a2fe
Sep 15 13:39:54.609786 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:39:54.609747    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k" event={"ID":"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7","Type":"ContainerStarted","Data":"a7393c5fea15f34b8cc4f4454f7a30befde6517959c3f9671b7b541f58d2a2fe"}
Sep 15 13:40:04.343499 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:04.343461    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:40:07.895058 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:07.895032    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:40:08.094037 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.092685    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gpdc4"]
Sep 15 13:40:08.669291 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.669191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79d9c677-gmgjc" event={"ID":"42c78a95-4adf-4f80-b78c-a35c6ace6175","Type":"ContainerStarted","Data":"e9ccafca3fba4e8d1efa2f1ac44aec81335730fe38efcea6c140304d3850da69"}
Sep 15 13:40:08.671145 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.671107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h" event={"ID":"34cf86ae-8ff2-4648-a277-535c017af72b","Type":"ContainerStarted","Data":"228b33aea274ef898f78e4bbe2bc9d683e7a67f1866aee49543160b58488232e"}
Sep 15 13:40:08.673969 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.673455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44z2n" event={"ID":"63292c14-fa9c-41ff-96ca-2347852d9c34","Type":"ContainerStarted","Data":"8aa9e907ce258ba884ff845d140c00a9fe91622fa1a7fd8d7422ebde5a280372"}
Sep 15 13:40:08.676389 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.676358    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jn9zl" event={"ID":"ff650f21-bc09-4874-b81b-b942a22d1556","Type":"ContainerStarted","Data":"963891c027ec1dfeec84d3420ee86d46156c12bee62cb7b529d2e7d9f084866a"}
Sep 15 13:40:08.676848 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.676825    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:40:08.679127 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.679097    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649" exitCode=0
Sep 15 13:40:08.681082 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.680974    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"}
Sep 15 13:40:08.681214 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.681135    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"84360b4def93fb6682620ed65bbdbefedfd7b46e6fe8725fe36cb82545d0b872"}
Sep 15 13:40:08.683933 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.683900    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k" event={"ID":"5f5d01f0-cc4f-48e3-b71d-b68c04b336c7","Type":"ContainerStarted","Data":"a1a27058c00b630f52de806e0914651233f34925eba56fcbacb81a2d08ba27ef"}
Sep 15 13:40:08.685008 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.684748    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:40:08.691503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.691462    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c79d9c677-gmgjc" podStartSLOduration=2.109021725 podStartE2EDuration="17.691444391s" totalImagesPullingTime="15.582422666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.69110654 +0000 UTC m=+83.940767849" watchObservedRunningTime="2026-09-15 13:40:08.691444391 +0000 UTC m=+83.941105686"
Sep 15 13:40:08.697432 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.696800    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k"
Sep 15 13:40:08.700126 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.700094    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"8f99cff7486d0be466b55893203b061a99475664c1b14c4cac9917f35bea8639"}
Sep 15 13:40:08.700415 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.700175    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"91819d2c324d7d1d426164ccb9d81ec1c5957b6f84737df642101936332322dd"}
Sep 15 13:40:08.700415 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.700219    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"8e3e8b676c30fe84c5f1b532636bc3dfd50d0b1532e9ec1b7e5e058626a027ad"}
Sep 15 13:40:08.702263 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.702231    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-m7x54" event={"ID":"4ea37fff-b707-43f1-b9f2-dd58647f1776","Type":"ContainerStarted","Data":"223831680a13f22233a486fb67c0c54cbb684aa1cfae257e6f189be16e55ec1b"}
Sep 15 13:40:08.702688 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.702630    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:40:08.707331 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.707296    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jknc" event={"ID":"36a140e3-e410-4d68-adc7-f92983bd75b8","Type":"ContainerStarted","Data":"372c9679352f5e3bba9c3ae80997f25834dfab8e55ae0bc37a3b2807f9676faf"}
Sep 15 13:40:08.707453 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.707366    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jknc" event={"ID":"36a140e3-e410-4d68-adc7-f92983bd75b8","Type":"ContainerStarted","Data":"7d1b3418c487a8cda47ccad1de741c5378fb5202f6dc91a72d376a76eb2d693a"}
Sep 15 13:40:08.709262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.709173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gpdc4" event={"ID":"aab5a1f9-daf6-431a-8e71-83be5dcd68e0","Type":"ContainerStarted","Data":"a3b555324e399c22d48e7e75601007a72bdfe22b9123fe853788913454bf73e7"}
Sep 15 13:40:08.709262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.709228    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gpdc4" event={"ID":"aab5a1f9-daf6-431a-8e71-83be5dcd68e0","Type":"ContainerStarted","Data":"f66905b2dc0300d019f77f5544a2802fc86ef4d355290ed9a1ff5e1dfbeb8b56"}
Sep 15 13:40:08.711737 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.711690    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-m7x54"
Sep 15 13:40:08.713768 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.713508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"}
Sep 15 13:40:08.713768 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.713572    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"}
Sep 15 13:40:08.713768 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.713615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"}
Sep 15 13:40:08.713768 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.713656    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"}
Sep 15 13:40:08.713768 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.713723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"}
Sep 15 13:40:08.746187 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.745932    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jn9zl" podStartSLOduration=67.517467039 podStartE2EDuration="1m23.745910235s" totalImagesPullingTime="16.228443196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.743964063 +0000 UTC m=+83.993625377" watchObservedRunningTime="2026-09-15 13:40:08.745910235 +0000 UTC m=+83.995571530"
Sep 15 13:40:08.762823 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.762754    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zbz8k" podStartSLOduration=3.9116277 podStartE2EDuration="17.762730873s" totalImagesPullingTime="13.851103173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.761281853 +0000 UTC m=+84.010943142" watchObservedRunningTime="2026-09-15 13:40:08.762730873 +0000 UTC m=+84.012392168"
Sep 15 13:40:08.801747 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.801691    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-44z2n" podStartSLOduration=67.536818109 podStartE2EDuration="1m23.801658336s" totalImagesPullingTime="16.264840227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.800601167 +0000 UTC m=+84.050262484" watchObservedRunningTime="2026-09-15 13:40:08.801658336 +0000 UTC m=+84.051319633"
Sep 15 13:40:08.802632 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.802574    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h" podStartSLOduration=1.952066796 podStartE2EDuration="17.802559526s" totalImagesPullingTime="15.85049273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.782328035 +0000 UTC m=+84.031989335" watchObservedRunningTime="2026-09-15 13:40:08.802559526 +0000 UTC m=+84.052220821"
Sep 15 13:40:08.843336 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.838269    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-m7x54" podStartSLOduration=1.906431794 podStartE2EDuration="27.838244144s" totalImagesPullingTime="25.93181235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.837457621 +0000 UTC m=+84.087118939" watchObservedRunningTime="2026-09-15 13:40:08.838244144 +0000 UTC m=+84.087905441"
Sep 15 13:40:08.856342 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:08.856269    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4jknc" podStartSLOduration=67.669418823 podStartE2EDuration="1m23.856248312s" totalImagesPullingTime="16.186829489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:08.855301706 +0000 UTC m=+84.104963026" watchObservedRunningTime="2026-09-15 13:40:08.856248312 +0000 UTC m=+84.105909611"
Sep 15 13:40:10.729989 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.729946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"02696573bebb4aa3ae6af72348986df871685b3e07e2d261b4c658b61d3b192f"}
Sep 15 13:40:10.730474 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.730038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"688499547d727416dace97353d23807ff398c39c442ce3725795689768e1eb13"}
Sep 15 13:40:10.730474 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.730085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" event={"ID":"145c74f9-8550-45e4-bfa3-e4a7f8812246","Type":"ContainerStarted","Data":"6fa7ba64cb45fff9eb51fbd5960c40eed005d7b0ae4e551044a37f7069e35ff7"}
Sep 15 13:40:10.731176 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.731151    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:40:10.734652 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.734565    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gpdc4" event={"ID":"aab5a1f9-daf6-431a-8e71-83be5dcd68e0","Type":"ContainerStarted","Data":"90829e0479aa506b85303013b434770810e7f8d68e8db30e29fc132a199b6e9b"}
Sep 15 13:40:10.741255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.741224    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerStarted","Data":"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"}
Sep 15 13:40:10.758995 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.758932    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5" podStartSLOduration=7.307821627 podStartE2EDuration="21.758909486s" totalImagesPullingTime="14.451087859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:10.751608509 +0000 UTC m=+86.001269846" watchObservedRunningTime="2026-09-15 13:40:10.758909486 +0000 UTC m=+86.008570781"
Sep 15 13:40:10.779885 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:10.779819    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.558203962 podStartE2EDuration="22.779796511s" totalImagesPullingTime="16.201709467s" totalInitContainerRuntime="19.883082ms" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:10.777733409 +0000 UTC m=+86.027394739" watchObservedRunningTime="2026-09-15 13:40:10.779796511 +0000 UTC m=+86.029457807"
Sep 15 13:40:11.652005 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:11.651960    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:40:11.652216 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:11.652068    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:40:12.016845 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:12.016714    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:40:14.769092 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769058    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"}
Sep 15 13:40:14.769600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769129    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"}
Sep 15 13:40:14.769600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769179    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"}
Sep 15 13:40:14.769600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769221    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"}
Sep 15 13:40:14.769600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"}
Sep 15 13:40:14.769600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.769288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerStarted","Data":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"}
Sep 15 13:40:14.771738 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.771710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gpdc4" event={"ID":"aab5a1f9-daf6-431a-8e71-83be5dcd68e0","Type":"ContainerStarted","Data":"4540a6a359d5a61331e6e36b107454a2e83a4edd1b401e57411ae2ee5d11dad1"}
Sep 15 13:40:14.807280 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.807217    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=16.511170877 podStartE2EDuration="21.807193887s" totalImagesPullingTime="5.257073951s" totalInitContainerRuntime="38.949059ms" isStatefulPod=false podCreationTimestamp="2026-09-15 13:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:14.805843626 +0000 UTC m=+90.055504937" watchObservedRunningTime="2026-09-15 13:40:14.807193887 +0000 UTC m=+90.056855184"
Sep 15 13:40:14.824325 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:14.824258    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gpdc4" podStartSLOduration=32.287558193 podStartE2EDuration="37.824236205s" totalImagesPullingTime="5.536678012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:40:14.823503449 +0000 UTC m=+90.073164755" watchObservedRunningTime="2026-09-15 13:40:14.824236205 +0000 UTC m=+90.073897501"
Sep 15 13:40:17.761133 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:17.761093    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7fbbb464fb-n4ld5"
Sep 15 13:40:18.494966 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:18.494918    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:40:31.657035 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:31.657005    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:40:31.660918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:31.660893    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fb557ff7b-wh79h"
Sep 15 13:40:33.697710 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:33.697632    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c79d9c677-gmgjc" podUID="42c78a95-4adf-4f80-b78c-a35c6ace6175" containerName="console" containerID="cri-o://e9ccafca3fba4e8d1efa2f1ac44aec81335730fe38efcea6c140304d3850da69" gracePeriod=15
Sep 15 13:40:33.856659 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:33.856628    2584 generic.go:356] "Generic (PLEG): container finished" podID="42c78a95-4adf-4f80-b78c-a35c6ace6175" containerID="e9ccafca3fba4e8d1efa2f1ac44aec81335730fe38efcea6c140304d3850da69" exitCode=0
Sep 15 13:40:33.856841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:33.856708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79d9c677-gmgjc" event={"ID":"42c78a95-4adf-4f80-b78c-a35c6ace6175","Type":"ContainerDied","Data":"e9ccafca3fba4e8d1efa2f1ac44aec81335730fe38efcea6c140304d3850da69"}
Sep 15 13:40:33.970770 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:33.970688    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:40:34.146052 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146013    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146052 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146053    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146155    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75rgx\" (UniqueName: \"kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146266    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146452 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146303    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert\") pod \"42c78a95-4adf-4f80-b78c-a35c6ace6175\" (UID: \"42c78a95-4adf-4f80-b78c-a35c6ace6175\") "
Sep 15 13:40:34.146504 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146478    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca" (OuterVolumeSpecName: "service-ca") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:40:34.147139 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.146455    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config" (OuterVolumeSpecName: "console-config") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:40:34.147397 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.147359    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:40:34.147542 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.147499    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.153471 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.153358    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:40:34.153471 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.153412    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx" (OuterVolumeSpecName: "kube-api-access-75rgx") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "kube-api-access-75rgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:40:34.153471 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.153441    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42c78a95-4adf-4f80-b78c-a35c6ace6175" (UID: "42c78a95-4adf-4f80-b78c-a35c6ace6175"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:40:34.248985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.248899    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-serving-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.248985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.248929    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75rgx\" (UniqueName: \"kubernetes.io/projected/42c78a95-4adf-4f80-b78c-a35c6ace6175-kube-api-access-75rgx\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.248985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.248942    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-oauth-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.248985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.248951    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-oauth-serving-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.248985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.248959    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42c78a95-4adf-4f80-b78c-a35c6ace6175-console-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:40:34.862190 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.862160    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79d9c677-gmgjc"
Sep 15 13:40:34.862594 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.862163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79d9c677-gmgjc" event={"ID":"42c78a95-4adf-4f80-b78c-a35c6ace6175","Type":"ContainerDied","Data":"98eba216caec82974648671bde74e9de289ad7ffc090dfcd19f5437e3bc01c46"}
Sep 15 13:40:34.872924 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.872899    2584 scope.go:117] "RemoveContainer" containerID="e9ccafca3fba4e8d1efa2f1ac44aec81335730fe38efcea6c140304d3850da69"
Sep 15 13:40:34.883971 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.883944    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:40:34.888374 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:34.888347    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c79d9c677-gmgjc"]
Sep 15 13:40:35.264731 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:35.264699    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42c78a95-4adf-4f80-b78c-a35c6ace6175" path="/var/lib/kubelet/pods/42c78a95-4adf-4f80-b78c-a35c6ace6175/volumes"
Sep 15 13:40:39.721416 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:39.721380    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jn9zl"
Sep 15 13:40:53.494945 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:53.494904    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:40:53.550973 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:53.550943    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:40:53.954884 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:40:53.954856    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:07.121368 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121328    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121718    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="alertmanager" containerID="cri-o://ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2" gracePeriod=120
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121773    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="config-reloader" containerID="cri-o://99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492" gracePeriod=120
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121774    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-web" containerID="cri-o://86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c" gracePeriod=120
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121743    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-metric" containerID="cri-o://ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86" gracePeriod=120
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121797    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="prom-label-proxy" containerID="cri-o://b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d" gracePeriod=120
Sep 15 13:41:07.121947 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.121847    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy" containerID="cri-o://b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9" gracePeriod=120
Sep 15 13:41:07.996115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996077    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d" exitCode=0
Sep 15 13:41:07.996115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996102    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86" exitCode=0
Sep 15 13:41:07.996115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996107    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9" exitCode=0
Sep 15 13:41:07.996115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996113    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492" exitCode=0
Sep 15 13:41:07.996115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996118    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2" exitCode=0
Sep 15 13:41:07.996402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996142    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"}
Sep 15 13:41:07.996402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"}
Sep 15 13:41:07.996402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996219    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"}
Sep 15 13:41:07.996402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"}
Sep 15 13:41:07.996402 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:07.996276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"}
Sep 15 13:41:08.361022 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.360992    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:08.426045 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426006    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426207 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426065    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426207 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426084    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426207 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426109    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv7qh\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426372 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426236    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426372 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426285    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426372 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426316    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426372 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426343    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426375    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426454    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426513    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.426568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.426547    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca\") pod \"35aba45e-737d-4ebc-867f-b9921f40f14d\" (UID: \"35aba45e-737d-4ebc-867f-b9921f40f14d\") "
Sep 15 13:41:08.427561 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.427452    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:41:08.432077 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.430109    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume" (OuterVolumeSpecName: "config-volume") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.432077 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.430745    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:08.432077 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.431592    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:08.432810 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.432730    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.433828 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.433075    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.433828 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.433116    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh" (OuterVolumeSpecName: "kube-api-access-gv7qh") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "kube-api-access-gv7qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:41:08.440564 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.440395    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.440798 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.440770    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.441051 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.440931    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out" (OuterVolumeSpecName: "config-out") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:41:08.441051 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.441012    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:41:08.441051 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.441031    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.450453 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.450414    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config" (OuterVolumeSpecName: "web-config") pod "35aba45e-737d-4ebc-867f-b9921f40f14d" (UID: "35aba45e-737d-4ebc-867f-b9921f40f14d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:08.532683 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532641    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532689    2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-cluster-tls-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532711    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv7qh\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-kube-api-access-gv7qh\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532725    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35aba45e-737d-4ebc-867f-b9921f40f14d-tls-assets\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532734    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-main-db\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532742    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35aba45e-737d-4ebc-867f-b9921f40f14d-config-out\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532751    2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532759    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532769    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532778    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532787    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-secret-alertmanager-main-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532795    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35aba45e-737d-4ebc-867f-b9921f40f14d-metrics-client-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:08.532841 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:08.532803    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35aba45e-737d-4ebc-867f-b9921f40f14d-web-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:09.003111 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.003077    2584 generic.go:356] "Generic (PLEG): container finished" podID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerID="86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c" exitCode=0
Sep 15 13:41:09.003255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.003163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"}
Sep 15 13:41:09.003255 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.003183    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.003343 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.003266    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35aba45e-737d-4ebc-867f-b9921f40f14d","Type":"ContainerDied","Data":"0eac56699c7e6141265c1abddf8d55c7c5e8066eebd9e4b6a66ae8482206d61d"}
Sep 15 13:41:09.003343 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.003301    2584 scope.go:117] "RemoveContainer" containerID="b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"
Sep 15 13:41:09.011884 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.011868    2584 scope.go:117] "RemoveContainer" containerID="ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"
Sep 15 13:41:09.019193 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.019171    2584 scope.go:117] "RemoveContainer" containerID="b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"
Sep 15 13:41:09.026741 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.026712    2584 scope.go:117] "RemoveContainer" containerID="86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"
Sep 15 13:41:09.027680 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.027636    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:09.031930 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.031904    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:09.035198 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.035183    2584 scope.go:117] "RemoveContainer" containerID="99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"
Sep 15 13:41:09.043478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.043459    2584 scope.go:117] "RemoveContainer" containerID="ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"
Sep 15 13:41:09.051889 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.051719    2584 scope.go:117] "RemoveContainer" containerID="87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38"
Sep 15 13:41:09.060412 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.060317    2584 scope.go:117] "RemoveContainer" containerID="b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"
Sep 15 13:41:09.060822 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.060795    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d\": container with ID starting with b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d not found: ID does not exist" containerID="b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"
Sep 15 13:41:09.060939 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.060834    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d"} err="failed to get container status \"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d\": rpc error: code = NotFound desc = could not find container \"b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d\": container with ID starting with b835f93668b9c235e26d11fa63ba2386c5ccba95d390bb2d2e3cc7325f6b881d not found: ID does not exist"
Sep 15 13:41:09.060939 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.060880    2584 scope.go:117] "RemoveContainer" containerID="ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"
Sep 15 13:41:09.061238 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.061219    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86\": container with ID starting with ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86 not found: ID does not exist" containerID="ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"
Sep 15 13:41:09.061280 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061245    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86"} err="failed to get container status \"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86\": rpc error: code = NotFound desc = could not find container \"ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86\": container with ID starting with ae40d12bcb12b9630b05cc861eedd45c47d6c742d12129e0a6fce84f4e3ede86 not found: ID does not exist"
Sep 15 13:41:09.061280 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061260    2584 scope.go:117] "RemoveContainer" containerID="b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"
Sep 15 13:41:09.061558 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.061539    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9\": container with ID starting with b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9 not found: ID does not exist" containerID="b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"
Sep 15 13:41:09.061620 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061562    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9"} err="failed to get container status \"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9\": rpc error: code = NotFound desc = could not find container \"b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9\": container with ID starting with b3a0fd6ea8ca4ffc6c1f0180261b4027aa54e4ab4a50b23428f48bcccfc8a6a9 not found: ID does not exist"
Sep 15 13:41:09.061620 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061579    2584 scope.go:117] "RemoveContainer" containerID="86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"
Sep 15 13:41:09.061763 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061744    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:09.061855 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.061838    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c\": container with ID starting with 86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c not found: ID does not exist" containerID="86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"
Sep 15 13:41:09.061888 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061860    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c"} err="failed to get container status \"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c\": rpc error: code = NotFound desc = could not find container \"86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c\": container with ID starting with 86874983accb2d37eca2bc0a067c5795cc72dd6a3824d60e0d0275f525b65b0c not found: ID does not exist"
Sep 15 13:41:09.061888 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.061873    2584 scope.go:117] "RemoveContainer" containerID="99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"
Sep 15 13:41:09.062140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062125    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="init-config-reloader"
Sep 15 13:41:09.062184 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062142    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="init-config-reloader"
Sep 15 13:41:09.062184 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062155    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-web"
Sep 15 13:41:09.062184 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062160    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-web"
Sep 15 13:41:09.062184 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062173    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="alertmanager"
Sep 15 13:41:09.062184 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062180    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="alertmanager"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062190    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-metric"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062195    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-metric"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.062172    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492\": container with ID starting with 99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492 not found: ID does not exist" containerID="99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062203    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="prom-label-proxy"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062209    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="prom-label-proxy"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062218    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062215    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492"} err="failed to get container status \"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492\": rpc error: code = NotFound desc = could not find container \"99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492\": container with ID starting with 99404cfdfdc32f9ceb55d89ca3470f55f2c322acaeab34f255de49288479f492 not found: ID does not exist"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062226    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062241    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42c78a95-4adf-4f80-b78c-a35c6ace6175" containerName="console"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062230    2584 scope.go:117] "RemoveContainer" containerID="ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062247    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="42c78a95-4adf-4f80-b78c-a35c6ace6175" containerName="console"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062330    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="config-reloader"
Sep 15 13:41:09.062337 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062339    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="config-reloader"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062402    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-metric"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062416    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="config-reloader"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062424    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062432    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="alertmanager"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062438    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="42c78a95-4adf-4f80-b78c-a35c6ace6175" containerName="console"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062446    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="prom-label-proxy"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062452    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" containerName="kube-rbac-proxy-web"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.062541    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2\": container with ID starting with ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2 not found: ID does not exist" containerID="ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062563    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2"} err="failed to get container status \"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2\": rpc error: code = NotFound desc = could not find container \"ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2\": container with ID starting with ac49d93e7a11e034e60547ac93aec07c1013772642686bee744a2baa698f71e2 not found: ID does not exist"
Sep 15 13:41:09.062819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062576    2584 scope.go:117] "RemoveContainer" containerID="87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38"
Sep 15 13:41:09.063135 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:09.062825    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38\": container with ID starting with 87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38 not found: ID does not exist" containerID="87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38"
Sep 15 13:41:09.063135 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.062848    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38"} err="failed to get container status \"87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38\": rpc error: code = NotFound desc = could not find container \"87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38\": container with ID starting with 87a8818b7482e63b9da17d2e2979ecf21744a119092567bc39ccf6f9d12abb38 not found: ID does not exist"
Sep 15 13:41:09.067750 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.067729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.070223 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070192    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 13:41:09.070341 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070316    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 13:41:09.070341 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070332    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 13:41:09.070446 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070350    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 13:41:09.070446 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070388    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 13:41:09.070653 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070634    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 13:41:09.070850 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.070836    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gwp2k\""
Sep 15 13:41:09.071127 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.071110    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 13:41:09.071182 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.071159    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 13:41:09.076246 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.076225    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 13:41:09.081601 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.081577    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:09.135918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.135881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.135918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.135916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.135945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-web-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136091    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136224    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvzm9\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-kube-api-access-pvzm9\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136395 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136373    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-out\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.136601 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.136397    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237357 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-web-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvzm9\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-kube-api-access-pvzm9\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237518    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237919 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.237919 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-out\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.238391 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.238361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.238500 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.237616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.238500 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.238467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.238604 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.238497    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.238661 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.238617    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.240597 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.240567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.240736 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.240593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-web-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.240801 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.240743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.240860 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.240805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.240915 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.240876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.241083 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.241044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-out\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.241205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.241183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.241259 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.241221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.241314 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.241262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.242593 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.242570    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.246454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.246426    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvzm9\" (UniqueName: \"kubernetes.io/projected/2fcc9702-b8b8-45cf-8b8a-ec69a1711e14-kube-api-access-pvzm9\") pod \"alertmanager-main-0\" (UID: \"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.262828 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.262753    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35aba45e-737d-4ebc-867f-b9921f40f14d" path="/var/lib/kubelet/pods/35aba45e-737d-4ebc-867f-b9921f40f14d/volumes"
Sep 15 13:41:09.378311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.378272    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 13:41:09.663269 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:09.663242    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 13:41:09.664582 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:41:09.664557    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcc9702_b8b8_45cf_8b8a_ec69a1711e14.slice/crio-73ae0ef879f02c371da8865ec5501364f57cc014088067f5ab9a60ed0649c38d WatchSource:0}: Error finding container 73ae0ef879f02c371da8865ec5501364f57cc014088067f5ab9a60ed0649c38d: Status 404 returned error can't find the container with id 73ae0ef879f02c371da8865ec5501364f57cc014088067f5ab9a60ed0649c38d
Sep 15 13:41:10.014148 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:10.014062    2584 generic.go:356] "Generic (PLEG): container finished" podID="2fcc9702-b8b8-45cf-8b8a-ec69a1711e14" containerID="56b43a35bcb379d58f454e692b8416aef9c67eecf694087d4dc4543238466cf4" exitCode=0
Sep 15 13:41:10.014148 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:10.014113    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerDied","Data":"56b43a35bcb379d58f454e692b8416aef9c67eecf694087d4dc4543238466cf4"}
Sep 15 13:41:10.014320 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:10.014196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"73ae0ef879f02c371da8865ec5501364f57cc014088067f5ab9a60ed0649c38d"}
Sep 15 13:41:11.021504 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"d995253c3f03750d360f6d58c796cd501d966bf02a17da6f38e0a8e6a972653e"}
Sep 15 13:41:11.021901 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021532    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"a03f3174b80a7dc25c356fe6b7c463d905fec58163d81c8f5dbafcc5e100dcd1"}
Sep 15 13:41:11.021901 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021557    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"fd05d9294114399aa3b2f8ae6d1c27eb18304b49aaf1fd7dde901c1a8bef164f"}
Sep 15 13:41:11.021901 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"cd49f0397d18a10a3e8ecd0efc7f1fea86ffdbd7610a6ac276f3fb2a72e8ae22"}
Sep 15 13:41:11.021901 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"95d95ed18a9eb9565f44c8d045d626b491a382ab897e69cb9f6e361caa90fe4a"}
Sep 15 13:41:11.021901 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.021633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fcc9702-b8b8-45cf-8b8a-ec69a1711e14","Type":"ContainerStarted","Data":"f413bc82104bbaee13c2e62a27b960a3ee6c759411fe0e15059f357e58db3486"}
Sep 15 13:41:11.053916 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.053856    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.033744453 podStartE2EDuration="2.053837697s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.093244ms" isStatefulPod=false podCreationTimestamp="2026-09-15 13:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:41:11.051246867 +0000 UTC m=+146.300908186" watchObservedRunningTime="2026-09-15 13:41:11.053837697 +0000 UTC m=+146.303498991"
Sep 15 13:41:11.452238 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.452203    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:11.452856 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.452822    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="prometheus" containerID="cri-o://8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16" gracePeriod=600
Sep 15 13:41:11.453289 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.453246    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="config-reloader" containerID="cri-o://c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1" gracePeriod=600
Sep 15 13:41:11.453400 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.453166    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741" gracePeriod=600
Sep 15 13:41:11.453488 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.453010    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy" containerID="cri-o://3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837" gracePeriod=600
Sep 15 13:41:11.453617 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.453202    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-web" containerID="cri-o://c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c" gracePeriod=600
Sep 15 13:41:11.453617 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.453185    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="thanos-sidecar" containerID="cri-o://1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638" gracePeriod=600
Sep 15 13:41:11.714614 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.714585    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:11.764471 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764438    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764471 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764483    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764729 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764509    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764729 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764534    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764844 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764763    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764900 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764867    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764905    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.764951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764944    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765051 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.764988    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765051 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765010    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.765637 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:41:11.765755 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765684    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765755 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765721    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765880 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765765    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765880 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765801    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765880 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765830    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.765880 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765856    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765887    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765918    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxh6p\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765953    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.765977    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766069 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.766002    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle\") pod \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\" (UID: \"7b5a3c9a-895c-4712-ae88-9aa425bb10c9\") "
Sep 15 13:41:11.766307 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.766276    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-db\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.766307 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.766295    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.767036 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.766910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.767326 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.767151    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.768304 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.768220    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.769386 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.768818    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.769386 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.768837    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.769386 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.769263    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.769584 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.769411    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:41:11.769584 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.769544    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:41:11.769584 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.769562    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.770060 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.770037    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.770283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.770224    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p" (OuterVolumeSpecName: "kube-api-access-mxh6p") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "kube-api-access-mxh6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:41:11.770356 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.770325    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.770428 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.770405    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.770478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.770464    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.771123 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.771083    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config" (OuterVolumeSpecName: "config") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.771494 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.771474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.772206 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.772177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out" (OuterVolumeSpecName: "config-out") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:41:11.785352 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.785319    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config" (OuterVolumeSpecName: "web-config") pod "7b5a3c9a-895c-4712-ae88-9aa425bb10c9" (UID: "7b5a3c9a-895c-4712-ae88-9aa425bb10c9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:41:11.867443 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867406    2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-grpc-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867443 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867440    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867443 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867450    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-web-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867460    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-metrics-client-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867468    2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867477    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867486    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867495    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-config-out\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867503    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxh6p\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-kube-api-access-mxh6p\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867510    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867518    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867527    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867535    2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867546    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867555    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-tls-assets\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867563    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867572    2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-metrics-client-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:11.867662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:11.867580    2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b5a3c9a-895c-4712-ae88-9aa425bb10c9-secret-kube-rbac-proxy\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029270    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741" exitCode=0
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029303    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837" exitCode=0
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029312    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c" exitCode=0
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029321    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638" exitCode=0
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029329    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1" exitCode=0
Sep 15 13:41:12.029361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029336    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16" exitCode=0
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029367    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029532    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029539    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029644    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"}
Sep 15 13:41:12.029929 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.029697    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b5a3c9a-895c-4712-ae88-9aa425bb10c9","Type":"ContainerDied","Data":"84360b4def93fb6682620ed65bbdbefedfd7b46e6fe8725fe36cb82545d0b872"}
Sep 15 13:41:12.038241 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.038216    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.047902 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.047875    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.053632 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.053603    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:12.056646 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.056622    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.058325 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.058306    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:12.064203 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.064177    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.071350 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.071331    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.079140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.079121    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.084283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084260    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:12.084578 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084566    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="config-reloader"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084579    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="config-reloader"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084591    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-web"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084597    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-web"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084608    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-thanos"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084614    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-thanos"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084622    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy"
Sep 15 13:41:12.084626 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084627    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084635    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="init-config-reloader"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084640    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="init-config-reloader"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084649    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="thanos-sidecar"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084654    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="thanos-sidecar"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084721    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="prometheus"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084732    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="prometheus"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084792    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-web"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084800    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="thanos-sidecar"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084806    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084812    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="config-reloader"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084818    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="kube-rbac-proxy-thanos"
Sep 15 13:41:12.084865 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.084823    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" containerName="prometheus"
Sep 15 13:41:12.087103 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.087085    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.087436 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.087416    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.087514 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.087447    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.087514 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.087470    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.087757 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.087737    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.087818 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.087769    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.087818 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.087792    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.088227 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.088200    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.088325 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088235    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.088325 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088258    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.088598 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.088572    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.088772 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088605    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.088772 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088626    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.088948 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.088926    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.089049 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088953    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.089049 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.088974    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.089248 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.089234    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.089311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089255    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.089311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089274    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.089505 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:41:12.089484    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.089543 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089514    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.089543 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089536    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.089791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089772    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.089852 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.089791    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.090073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090055    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.090139 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090075    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.090296 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090273    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.090338 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090300    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.090338 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090324    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.090613 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090578    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.090613 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090608    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.090967 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090944    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.091033 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.090969    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.091251 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091232    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.091324 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091254    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.091527 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091510    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.091594 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091528    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.091791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091773    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.091852 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.091792    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.092052 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092028    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.092144 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092053    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.092300 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092273    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.092359 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092302    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.092589 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092571    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.092655 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092589    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.092928 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092904    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.093030 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.092929    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.093115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093035    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 13:41:12.093115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093043    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c5e9bbg2i89n7\""
Sep 15 13:41:12.093115 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093098    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 13:41:12.093283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093046    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 13:41:12.093283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093180    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 13:41:12.093283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093261    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.093470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093286    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.093470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093414    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 13:41:12.093470 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093483    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 13:41:12.093638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093498    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 13:41:12.093638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093584    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.093638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093506    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 13:41:12.093638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093620    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 13:41:12.093846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093687    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 13:41:12.093846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093608    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.093846 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093765    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 13:41:12.094055 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.093929    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 13:41:12.094055 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094015    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.094055 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094032    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.094231 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094084    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bz5bd\""
Sep 15 13:41:12.094309 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094292    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.094407 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094307    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.094645 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094626    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.094645 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094645    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.094944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094928    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.095017 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.094945    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.095234 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095213    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.095234 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095234    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.095538 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095512    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.095647 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095541    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.095867 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095846    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.095867 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.095866    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.096128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096102    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.096252 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096131    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.096418 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096394    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.096472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096421    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.096710 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096684    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.096797 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096712    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.096797 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096772    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 13:41:12.097001 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.096980    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.097001 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097001    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.097244 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097225    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.097320 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097245    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.097583 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097557    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.097583 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097582    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.097889 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097865    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.097964 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.097892    2584 scope.go:117] "RemoveContainer" containerID="a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"
Sep 15 13:41:12.098158 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098140    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741"} err="failed to get container status \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": rpc error: code = NotFound desc = could not find container \"a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741\": container with ID starting with a91f7f80e38a529c02b9b33f75d590fda0ec403d80eba937790965e04a631741 not found: ID does not exist"
Sep 15 13:41:12.098217 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098161    2584 scope.go:117] "RemoveContainer" containerID="3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"
Sep 15 13:41:12.098484 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098422    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837"} err="failed to get container status \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": rpc error: code = NotFound desc = could not find container \"3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837\": container with ID starting with 3560186e0df16c0a7d7fab55f982dca10c93f3bb583940ca8d7a08bccc2a5837 not found: ID does not exist"
Sep 15 13:41:12.098484 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098441    2584 scope.go:117] "RemoveContainer" containerID="c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"
Sep 15 13:41:12.098711 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098682    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c"} err="failed to get container status \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": rpc error: code = NotFound desc = could not find container \"c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c\": container with ID starting with c51f5de194825a6ca073c7a2a88d0b261ed580ea195b0786229ef51da27cd74c not found: ID does not exist"
Sep 15 13:41:12.098819 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098711    2584 scope.go:117] "RemoveContainer" containerID="1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"
Sep 15 13:41:12.099021 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.098986    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638"} err="failed to get container status \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": rpc error: code = NotFound desc = could not find container \"1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638\": container with ID starting with 1cbe624277498b78ad1bb8edac2346fee072c376a86ebe02025ccbe3c0a72638 not found: ID does not exist"
Sep 15 13:41:12.099021 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099013    2584 scope.go:117] "RemoveContainer" containerID="c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"
Sep 15 13:41:12.099350 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099321    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1"} err="failed to get container status \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": rpc error: code = NotFound desc = could not find container \"c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1\": container with ID starting with c50baa8967531fd18a6d0ec30d813a19d16ca40b37b017c86a570aef48c3fba1 not found: ID does not exist"
Sep 15 13:41:12.099433 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099351    2584 scope.go:117] "RemoveContainer" containerID="8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"
Sep 15 13:41:12.099619 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099598    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16"} err="failed to get container status \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": rpc error: code = NotFound desc = could not find container \"8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16\": container with ID starting with 8a63104f60055294b490354862c989a6c585b7a6ffc3dd78f7f6b813efb39a16 not found: ID does not exist"
Sep 15 13:41:12.099733 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099621    2584 scope.go:117] "RemoveContainer" containerID="3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"
Sep 15 13:41:12.099868 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.099850    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649"} err="failed to get container status \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": rpc error: code = NotFound desc = could not find container \"3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649\": container with ID starting with 3e2c6bc33193d822a6d08c8225f17b64edbd4d777d2617a71df61ea943a06649 not found: ID does not exist"
Sep 15 13:41:12.100298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.100276    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 13:41:12.106458 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.106438    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:12.169870 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.169828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.169880    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.169909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.169964    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170026 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170009    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170267 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170192    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb76d\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-kube-api-access-wb76d\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170878 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170701    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.170878 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.170742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271329 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271329 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271488    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271726    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.271826 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.272260 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb76d\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-kube-api-access-wb76d\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.272260 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.271885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.272260 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.272221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.272565 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.272512    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.272791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.272767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.273150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274205 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.273318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274389 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.274366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274556 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.274532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274660 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.274638    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.274914 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.274887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.275021 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.274945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.275307 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.275247    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.275944 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.275918    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-config\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.276029 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.275956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.276105 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.276080    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.276739 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.276718    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.277155 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.277126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.277155 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.277143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.277405 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.277384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.277622 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.277606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.283480 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.283429    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb76d\" (UniqueName: \"kubernetes.io/projected/0c06be11-81a6-4b52-ae2c-e8ed9c2c7148-kube-api-access-wb76d\") pod \"prometheus-k8s-0\" (UID: \"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.402263 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.402225    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:41:12.684803 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:12.684778    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 13:41:12.686297 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:41:12.686271    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c06be11_81a6_4b52_ae2c_e8ed9c2c7148.slice/crio-a5ae6f8715d31be186b32e52380f3cbfbe8e002e6ca0b7a93fd09e90b354bb33 WatchSource:0}: Error finding container a5ae6f8715d31be186b32e52380f3cbfbe8e002e6ca0b7a93fd09e90b354bb33: Status 404 returned error can't find the container with id a5ae6f8715d31be186b32e52380f3cbfbe8e002e6ca0b7a93fd09e90b354bb33
Sep 15 13:41:13.036506 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:13.036417    2584 generic.go:356] "Generic (PLEG): container finished" podID="0c06be11-81a6-4b52-ae2c-e8ed9c2c7148" containerID="b4cc7d547d03d24366084d5ff8641b156ca8b0e71ef3fa9cf2bc86b3aa6f3478" exitCode=0
Sep 15 13:41:13.036506 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:13.036467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerDied","Data":"b4cc7d547d03d24366084d5ff8641b156ca8b0e71ef3fa9cf2bc86b3aa6f3478"}
Sep 15 13:41:13.036924 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:13.036516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"a5ae6f8715d31be186b32e52380f3cbfbe8e002e6ca0b7a93fd09e90b354bb33"}
Sep 15 13:41:13.267290 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:13.267050    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5a3c9a-895c-4712-ae88-9aa425bb10c9" path="/var/lib/kubelet/pods/7b5a3c9a-895c-4712-ae88-9aa425bb10c9/volumes"
Sep 15 13:41:14.045376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045342    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"61eafb8e22768b50100b2075ba5d356427f4566ab3d3d3c94c5ab76fe873b0bf"}
Sep 15 13:41:14.045779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045408    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"224f26cc58307fa4f3d3e6283b33ea0075b91a7238ba842728331399b7dc853d"}
Sep 15 13:41:14.045779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045434    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"a450593187be74531698d0dccdaa78510a155dad8fd3425af432ce5439cc7245"}
Sep 15 13:41:14.045779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"e7620d0818e04388bc23349af727de54a56c3b3e552b21eddaf1a6bd6b6d19e0"}
Sep 15 13:41:14.045779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"bd8274411ce0df9648458e848cbae95984151273d138c59b90b1ed4c34ca0354"}
Sep 15 13:41:14.045779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.045512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c06be11-81a6-4b52-ae2c-e8ed9c2c7148","Type":"ContainerStarted","Data":"c6d0aa46249343d35e742b46c87dd9263f9ff7af153869b8982ef3748b59ed67"}
Sep 15 13:41:14.075067 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:14.075009    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.055555036 podStartE2EDuration="2.074988347s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.433311ms" isStatefulPod=false podCreationTimestamp="2026-09-15 13:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:41:14.072490675 +0000 UTC m=+149.322151994" watchObservedRunningTime="2026-09-15 13:41:14.074988347 +0000 UTC m=+149.324649641"
Sep 15 13:41:17.402984 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:41:17.402929    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:42:12.403000 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:42:12.402961    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:42:12.418341 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:42:12.418313    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:42:13.301286 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:42:13.301255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 13:43:45.190897 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:43:45.190866    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 13:44:03.465334 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.465291    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9dgkb"]
Sep 15 13:44:03.468661 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.468644    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.471129 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.471105    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 13:44:03.472044 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.472028    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 13:44:03.472109 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.472038    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wxx99\""
Sep 15 13:44:03.476001 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.475976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9dgkb"]
Sep 15 13:44:03.621189 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.621136    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r52m9\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-kube-api-access-r52m9\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.621383 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.621238    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.721966 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.721873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r52m9\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-kube-api-access-r52m9\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.722151 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.721979    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.730340 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.730309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.730484 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.730465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r52m9\" (UniqueName: \"kubernetes.io/projected/6c07f1ec-a734-4b2e-a013-39cdc5729eb7-kube-api-access-r52m9\") pod \"cert-manager-webhook-6486ffd997-9dgkb\" (UID: \"6c07f1ec-a734-4b2e-a013-39cdc5729eb7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:03.789455 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:03.789413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:04.060002 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:04.059976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9dgkb"]
Sep 15 13:44:04.062533 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:44:04.062504    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c07f1ec_a734_4b2e_a013_39cdc5729eb7.slice/crio-faf14d75eb7b28e99ab2d0cde5e1437b9a38d10350e463f1aa5338bb84084cc4 WatchSource:0}: Error finding container faf14d75eb7b28e99ab2d0cde5e1437b9a38d10350e463f1aa5338bb84084cc4: Status 404 returned error can't find the container with id faf14d75eb7b28e99ab2d0cde5e1437b9a38d10350e463f1aa5338bb84084cc4
Sep 15 13:44:04.065123 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:04.065102    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:44:04.731258 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:04.731223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb" event={"ID":"6c07f1ec-a734-4b2e-a013-39cdc5729eb7","Type":"ContainerStarted","Data":"faf14d75eb7b28e99ab2d0cde5e1437b9a38d10350e463f1aa5338bb84084cc4"}
Sep 15 13:44:08.751321 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:08.751283    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb" event={"ID":"6c07f1ec-a734-4b2e-a013-39cdc5729eb7","Type":"ContainerStarted","Data":"220fe92da6004ec40b6e5add2e3d01c650b158933881350a03d4c97705d920b1"}
Sep 15 13:44:08.751748 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:08.751356    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:08.768415 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:08.768361    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb" podStartSLOduration=2.001652033 podStartE2EDuration="5.768345965s" totalImagesPullingTime="3.766693932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:08.767078349 +0000 UTC m=+324.016739662" watchObservedRunningTime="2026-09-15 13:44:08.768345965 +0000 UTC m=+324.018007258"
Sep 15 13:44:14.758523 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:14.758485    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9dgkb"
Sep 15 13:44:16.640129 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.640094    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbjd7"]
Sep 15 13:44:16.643800 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.643773    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.646050 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.646026    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5jndl\""
Sep 15 13:44:16.653741 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.653712    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbjd7"]
Sep 15 13:44:16.726581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.726547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.726778 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.726646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wkvm\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-kube-api-access-2wkvm\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.827279 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.827240    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.827485 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.827320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wkvm\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-kube-api-access-2wkvm\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.834574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.834544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.834730 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.834626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wkvm\" (UniqueName: \"kubernetes.io/projected/5b77794e-2e11-4e73-8d0e-d4a8c65d5daf-kube-api-access-2wkvm\") pod \"cert-manager-55b4d954d5-lbjd7\" (UID: \"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf\") " pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:16.953878 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:16.953790    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lbjd7"
Sep 15 13:44:17.222589 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:17.222483    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbjd7"]
Sep 15 13:44:17.225058 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:44:17.225025    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b77794e_2e11_4e73_8d0e_d4a8c65d5daf.slice/crio-4d34b6d3422f343533d1bdab6240967fe282125ed50190a4f523b7b9c8cdaaf0 WatchSource:0}: Error finding container 4d34b6d3422f343533d1bdab6240967fe282125ed50190a4f523b7b9c8cdaaf0: Status 404 returned error can't find the container with id 4d34b6d3422f343533d1bdab6240967fe282125ed50190a4f523b7b9c8cdaaf0
Sep 15 13:44:17.790839 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:17.790802    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lbjd7" event={"ID":"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf","Type":"ContainerStarted","Data":"5cd07ad6b5599a0357793ee047762da5bdaefe269266d4683226e9dfc2abe9bf"}
Sep 15 13:44:17.790839 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:17.790844    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lbjd7" event={"ID":"5b77794e-2e11-4e73-8d0e-d4a8c65d5daf","Type":"ContainerStarted","Data":"4d34b6d3422f343533d1bdab6240967fe282125ed50190a4f523b7b9c8cdaaf0"}
Sep 15 13:44:17.806716 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:17.806644    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lbjd7" podStartSLOduration=1.806626422 podStartE2EDuration="1.806626422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:17.806222176 +0000 UTC m=+333.055883483" watchObservedRunningTime="2026-09-15 13:44:17.806626422 +0000 UTC m=+333.056287720"
Sep 15 13:44:32.861272 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.861234    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"]
Sep 15 13:44:32.865288 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.865255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:32.873956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.867992    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 13:44:32.873956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.871868    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p7czt\""
Sep 15 13:44:32.873956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.872225    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 13:44:32.873956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.872550    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 13:44:32.873956 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.872651    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 13:44:32.884852 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.884819    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"]
Sep 15 13:44:32.961638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.961601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:32.961830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.961652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:32.961830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.961737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:32.961830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.961784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srssk\" (UniqueName: \"kubernetes.io/projected/f563eb5c-2ee2-4021-a095-518d2e65fa1d-kube-api-access-srssk\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:32.961940 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:32.961850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063179 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srssk\" (UniqueName: \"kubernetes.io/projected/f563eb5c-2ee2-4021-a095-518d2e65fa1d-kube-api-access-srssk\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.063733 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.063709    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-manifests\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.065615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.065591    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f563eb5c-2ee2-4021-a095-518d2e65fa1d-tmp\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.065900 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.065881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.066053 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.066031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f563eb5c-2ee2-4021-a095-518d2e65fa1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.071515 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.071485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srssk\" (UniqueName: \"kubernetes.io/projected/f563eb5c-2ee2-4021-a095-518d2e65fa1d-kube-api-access-srssk\") pod \"opendatahub-operator-controller-manager-79c64c4b4d-52xsk\" (UID: \"f563eb5c-2ee2-4021-a095-518d2e65fa1d\") " pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.184070 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.184027    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:33.484886 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.484716    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"]
Sep 15 13:44:33.487657 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:44:33.487627    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf563eb5c_2ee2_4021_a095_518d2e65fa1d.slice/crio-034d9f6b80dc6122ebcb890ad211cb7b10f3e9112ee2622fa0421b0ee9d8be37 WatchSource:0}: Error finding container 034d9f6b80dc6122ebcb890ad211cb7b10f3e9112ee2622fa0421b0ee9d8be37: Status 404 returned error can't find the container with id 034d9f6b80dc6122ebcb890ad211cb7b10f3e9112ee2622fa0421b0ee9d8be37
Sep 15 13:44:33.857230 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:33.857146    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk" event={"ID":"f563eb5c-2ee2-4021-a095-518d2e65fa1d","Type":"ContainerStarted","Data":"034d9f6b80dc6122ebcb890ad211cb7b10f3e9112ee2622fa0421b0ee9d8be37"}
Sep 15 13:44:36.874046 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:36.873954    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk" event={"ID":"f563eb5c-2ee2-4021-a095-518d2e65fa1d","Type":"ContainerStarted","Data":"07a9fe985655a54b2c49b5ce1ff0ac6fc40ea9e3258ea84ccddcde94df244f04"}
Sep 15 13:44:37.879482 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:37.879384    2584 generic.go:356] "Generic (PLEG): container finished" podID="f563eb5c-2ee2-4021-a095-518d2e65fa1d" containerID="07a9fe985655a54b2c49b5ce1ff0ac6fc40ea9e3258ea84ccddcde94df244f04" exitCode=0
Sep 15 13:44:37.879482 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:37.879444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk" event={"ID":"f563eb5c-2ee2-4021-a095-518d2e65fa1d","Type":"ContainerDied","Data":"07a9fe985655a54b2c49b5ce1ff0ac6fc40ea9e3258ea84ccddcde94df244f04"}
Sep 15 13:44:38.887171 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:38.887138    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk" event={"ID":"f563eb5c-2ee2-4021-a095-518d2e65fa1d","Type":"ContainerStarted","Data":"6181847e03f7f19cc3d9063d32609918a436fdc02aca04ae621101b14e2f40eb"}
Sep 15 13:44:38.887539 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:38.887258    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:44:38.909035 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:38.908943    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk" podStartSLOduration=2.463006691 podStartE2EDuration="6.908920955s" totalImagesPullingTime="3.350574353s" totalInitContainerRuntime="1.095339911s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:44:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:44:38.907795858 +0000 UTC m=+354.157457177" watchObservedRunningTime="2026-09-15 13:44:38.908920955 +0000 UTC m=+354.158582249"
Sep 15 13:44:49.894492 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:44:49.894459    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c64c4b4d-52xsk"
Sep 15 13:45:11.531117 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.531078    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"]
Sep 15 13:45:11.535148 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.535119    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.541017 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.540985    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 13:45:11.541305 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.541286    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 13:45:11.541720 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.541697    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 13:45:11.541939 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.541923    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 13:45:11.542159 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.542139    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l8rhm\""
Sep 15 13:45:11.542222 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.542165    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 13:45:11.542373 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.542356    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 13:45:11.550256 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.550230    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"]
Sep 15 13:45:11.612992 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.612952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.612992 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.612988    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.613254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.613080    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90139334-c827-4d7c-996a-8910e3f9e684-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.613254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.613110    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2sj8\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-kube-api-access-l2sj8\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.613254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.613135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.613254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.613213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.613254 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.613249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714467 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714467 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714743 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714743 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90139334-c827-4d7c-996a-8910e3f9e684-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714743 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2sj8\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-kube-api-access-l2sj8\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714867 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.714867 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.714793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.715570 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.715537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.717154 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.717123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90139334-c827-4d7c-996a-8910e3f9e684-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.717291 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.717199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.717365 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.717300    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.717423 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.717361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90139334-c827-4d7c-996a-8910e3f9e684-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.723063 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.723028    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.723338 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.723320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2sj8\" (UniqueName: \"kubernetes.io/projected/90139334-c827-4d7c-996a-8910e3f9e684-kube-api-access-l2sj8\") pod \"istiod-openshift-gateway-5677ccb49b-fkt6n\" (UID: \"90139334-c827-4d7c-996a-8910e3f9e684\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:11.850388 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:11.850296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:12.135735 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.135703    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"]
Sep 15 13:45:12.138601 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:45:12.138574    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90139334_c827_4d7c_996a_8910e3f9e684.slice/crio-d9c58378f578515da0e5e406f522b265f06bdfa86d75aa21881fd74774952965 WatchSource:0}: Error finding container d9c58378f578515da0e5e406f522b265f06bdfa86d75aa21881fd74774952965: Status 404 returned error can't find the container with id d9c58378f578515da0e5e406f522b265f06bdfa86d75aa21881fd74774952965
Sep 15 13:45:12.324322 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.324284    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"]
Sep 15 13:45:12.328510 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.328475    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.331478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.331452    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 13:45:12.331763 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.331746    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 13:45:12.331965 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.331951    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 13:45:12.332742 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.332720    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 13:45:12.332830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.332720    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rnhvs\""
Sep 15 13:45:12.332830 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.332731    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 13:45:12.340469 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.340439    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"]
Sep 15 13:45:12.420490 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.420400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.420650 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.420522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91ccf213-4435-4145-9a7e-cfbd8065a7d5-manager-config\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.420650 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.420555    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-metrics-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.420650 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.420580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5trj\" (UniqueName: \"kubernetes.io/projected/91ccf213-4435-4145-9a7e-cfbd8065a7d5-kube-api-access-j5trj\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.521477 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.521444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.521692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.521514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91ccf213-4435-4145-9a7e-cfbd8065a7d5-manager-config\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.521692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.521537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-metrics-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.521692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.521552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5trj\" (UniqueName: \"kubernetes.io/projected/91ccf213-4435-4145-9a7e-cfbd8065a7d5-kube-api-access-j5trj\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.522284 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.522262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91ccf213-4435-4145-9a7e-cfbd8065a7d5-manager-config\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.524029 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.524009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-metrics-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.524095 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.524077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ccf213-4435-4145-9a7e-cfbd8065a7d5-cert\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.529737 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.529714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5trj\" (UniqueName: \"kubernetes.io/projected/91ccf213-4435-4145-9a7e-cfbd8065a7d5-kube-api-access-j5trj\") pod \"lws-controller-manager-6445fb96b-tbdck\" (UID: \"91ccf213-4435-4145-9a7e-cfbd8065a7d5\") " pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.637883 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.637848    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:12.932099 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:12.932024    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"]
Sep 15 13:45:13.058751 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:13.058642    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n" event={"ID":"90139334-c827-4d7c-996a-8910e3f9e684","Type":"ContainerStarted","Data":"d9c58378f578515da0e5e406f522b265f06bdfa86d75aa21881fd74774952965"}
Sep 15 13:45:13.070781 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:45:13.070735    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ccf213_4435_4145_9a7e_cfbd8065a7d5.slice/crio-45b2477ae7c4ca8b24f74ed56752d13895c81ea7b384066762a80b3eac9fbea4 WatchSource:0}: Error finding container 45b2477ae7c4ca8b24f74ed56752d13895c81ea7b384066762a80b3eac9fbea4: Status 404 returned error can't find the container with id 45b2477ae7c4ca8b24f74ed56752d13895c81ea7b384066762a80b3eac9fbea4
Sep 15 13:45:14.065686 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:14.065631    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck" event={"ID":"91ccf213-4435-4145-9a7e-cfbd8065a7d5","Type":"ContainerStarted","Data":"45b2477ae7c4ca8b24f74ed56752d13895c81ea7b384066762a80b3eac9fbea4"}
Sep 15 13:45:14.650034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:14.649988    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 15 13:45:14.650182 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:14.650066    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 15 13:45:15.074429 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:15.074308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n" event={"ID":"90139334-c827-4d7c-996a-8910e3f9e684","Type":"ContainerStarted","Data":"178dd0c9d16943fe7687ebfd3d2e53e5de4c2d1a98731bdc87849a5cf6e86b73"}
Sep 15 13:45:15.074907 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:15.074596    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:15.076329 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:15.076301    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fkt6n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 13:45:15.076491 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:15.076354    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n" podUID="90139334-c827-4d7c-996a-8910e3f9e684" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 13:45:15.113948 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:15.113850    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n" podStartSLOduration=1.605399277 podStartE2EDuration="4.113819686s" totalImagesPullingTime="2.508420409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:15.110523819 +0000 UTC m=+390.360185137" watchObservedRunningTime="2026-09-15 13:45:15.113819686 +0000 UTC m=+390.363480981"
Sep 15 13:45:16.080861 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:16.080829    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fkt6n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 13:45:16.081216 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:16.080907    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n" podUID="90139334-c827-4d7c-996a-8910e3f9e684" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 13:45:17.085303 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:17.085263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck" event={"ID":"91ccf213-4435-4145-9a7e-cfbd8065a7d5","Type":"ContainerStarted","Data":"8e71579eff36ca525e3f6f4573860f0c0e85a39af7437d72fab303320d02c7b0"}
Sep 15 13:45:17.085706 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:17.085356    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:45:17.105143 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:17.105083    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck" podStartSLOduration=1.602527846 podStartE2EDuration="5.105064122s" totalImagesPullingTime="3.502536276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:45:17.103882573 +0000 UTC m=+392.353543892" watchObservedRunningTime="2026-09-15 13:45:17.105064122 +0000 UTC m=+392.354725487"
Sep 15 13:45:19.081185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:19.081148    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n"
Sep 15 13:45:28.092517 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:45:28.092482    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6445fb96b-tbdck"
Sep 15 13:47:36.021779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.021741    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:36.025207 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.025189    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.027916 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.027885    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 13:47:36.028046 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.027974    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 13:47:36.028825 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.028810    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7kjhd\""
Sep 15 13:47:36.028879 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.028814    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 13:47:36.033275 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.033249    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:36.102630 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.102598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6q2p\" (UniqueName: \"kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.102829 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.102779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.117779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.117742    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:36.203171 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.203135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.203339 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.203180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6q2p\" (UniqueName: \"kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.203908 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.203880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.212360 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.212317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6q2p\" (UniqueName: \"kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p\") pod \"limitador-limitador-8588749977-76dw6\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") " pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.337175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.337089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:36.612347 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.612254    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:36.614715 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:47:36.614660    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b76477_004f_4a23_9964_f4e5e7d5d97d.slice/crio-6cb0f1f1d0a0770130be4dd6e29683c48d1ac5a1d050c96e09b0c6ffaa483185 WatchSource:0}: Error finding container 6cb0f1f1d0a0770130be4dd6e29683c48d1ac5a1d050c96e09b0c6ffaa483185: Status 404 returned error can't find the container with id 6cb0f1f1d0a0770130be4dd6e29683c48d1ac5a1d050c96e09b0c6ffaa483185
Sep 15 13:47:36.758013 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:36.757978    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" event={"ID":"97b76477-004f-4a23-9964-f4e5e7d5d97d","Type":"ContainerStarted","Data":"6cb0f1f1d0a0770130be4dd6e29683c48d1ac5a1d050c96e09b0c6ffaa483185"}
Sep 15 13:47:39.775118 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:39.775079    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" event={"ID":"97b76477-004f-4a23-9964-f4e5e7d5d97d","Type":"ContainerStarted","Data":"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"}
Sep 15 13:47:39.775568 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:39.775218    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:49.849425 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:49.849366    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" podStartSLOduration=11.391513439 podStartE2EDuration="13.849347074s" totalImagesPullingTime="2.457833635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:47:39.808880464 +0000 UTC m=+535.058541789" watchObservedRunningTime="2026-09-15 13:47:49.849347074 +0000 UTC m=+545.099008410"
Sep 15 13:47:49.850304 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:49.850281    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:49.850546 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:49.850513    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" podUID="97b76477-004f-4a23-9964-f4e5e7d5d97d" containerName="limitador" containerID="cri-o://f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4" gracePeriod=30
Sep 15 13:47:49.851375 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:49.851321    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:50.399631 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.399605    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:50.538182 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.538080    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6q2p\" (UniqueName: \"kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p\") pod \"97b76477-004f-4a23-9964-f4e5e7d5d97d\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") "
Sep 15 13:47:50.538358 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.538224    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file\") pod \"97b76477-004f-4a23-9964-f4e5e7d5d97d\" (UID: \"97b76477-004f-4a23-9964-f4e5e7d5d97d\") "
Sep 15 13:47:50.538580 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.538554    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file" (OuterVolumeSpecName: "config-file") pod "97b76477-004f-4a23-9964-f4e5e7d5d97d" (UID: "97b76477-004f-4a23-9964-f4e5e7d5d97d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:47:50.540359 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.540332    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p" (OuterVolumeSpecName: "kube-api-access-h6q2p") pod "97b76477-004f-4a23-9964-f4e5e7d5d97d" (UID: "97b76477-004f-4a23-9964-f4e5e7d5d97d"). InnerVolumeSpecName "kube-api-access-h6q2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:47:50.639806 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.639769    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97b76477-004f-4a23-9964-f4e5e7d5d97d-config-file\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:47:50.639806 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.639799    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6q2p\" (UniqueName: \"kubernetes.io/projected/97b76477-004f-4a23-9964-f4e5e7d5d97d-kube-api-access-h6q2p\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:47:50.827054 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.826967    2584 generic.go:356] "Generic (PLEG): container finished" podID="97b76477-004f-4a23-9964-f4e5e7d5d97d" containerID="f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4" exitCode=0
Sep 15 13:47:50.827054 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.827016    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-76dw6"
Sep 15 13:47:50.827054 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.827035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" event={"ID":"97b76477-004f-4a23-9964-f4e5e7d5d97d","Type":"ContainerDied","Data":"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"}
Sep 15 13:47:50.827262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.827084    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-76dw6" event={"ID":"97b76477-004f-4a23-9964-f4e5e7d5d97d","Type":"ContainerDied","Data":"6cb0f1f1d0a0770130be4dd6e29683c48d1ac5a1d050c96e09b0c6ffaa483185"}
Sep 15 13:47:50.827262 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.827109    2584 scope.go:117] "RemoveContainer" containerID="f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"
Sep 15 13:47:50.836552 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.836532    2584 scope.go:117] "RemoveContainer" containerID="f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"
Sep 15 13:47:50.836964 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:47:50.836939    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4\": container with ID starting with f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4 not found: ID does not exist" containerID="f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"
Sep 15 13:47:50.837057 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.836970    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4"} err="failed to get container status \"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4\": rpc error: code = NotFound desc = could not find container \"f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4\": container with ID starting with f8421a478035d4125b7187d1493762fd5bbd607a8a38befb3f16c07fe774c9a4 not found: ID does not exist"
Sep 15 13:47:50.848331 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.848306    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:50.851900 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:50.851877    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-76dw6"]
Sep 15 13:47:51.262899 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:51.262867    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b76477-004f-4a23-9964-f4e5e7d5d97d" path="/var/lib/kubelet/pods/97b76477-004f-4a23-9964-f4e5e7d5d97d/volumes"
Sep 15 13:47:52.425933 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.425901    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"]
Sep 15 13:47:52.426367 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.426351    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b76477-004f-4a23-9964-f4e5e7d5d97d" containerName="limitador"
Sep 15 13:47:52.426410 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.426370    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b76477-004f-4a23-9964-f4e5e7d5d97d" containerName="limitador"
Sep 15 13:47:52.426448 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.426427    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b76477-004f-4a23-9964-f4e5e7d5d97d" containerName="limitador"
Sep 15 13:47:52.432915 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.432895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.435603 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.435584    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 13:47:52.435821 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.435806    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 13:47:52.435898 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.435876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-97fqm\""
Sep 15 13:47:52.436593 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.436578    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 13:47:52.441177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.441155    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"]
Sep 15 13:47:52.555630 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.555590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bsds\" (UniqueName: \"kubernetes.io/projected/19130448-4cdf-43d6-8da4-1fbbbb6621e5-kube-api-access-2bsds\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.555824 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.555644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/19130448-4cdf-43d6-8da4-1fbbbb6621e5-data\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.656551 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.656511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/19130448-4cdf-43d6-8da4-1fbbbb6621e5-data\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.656753 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.656610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bsds\" (UniqueName: \"kubernetes.io/projected/19130448-4cdf-43d6-8da4-1fbbbb6621e5-kube-api-access-2bsds\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.656930 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.656908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/19130448-4cdf-43d6-8da4-1fbbbb6621e5-data\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.664948 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.664922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bsds\" (UniqueName: \"kubernetes.io/projected/19130448-4cdf-43d6-8da4-1fbbbb6621e5-kube-api-access-2bsds\") pod \"postgres-69fb4594cf-6bc68\" (UID: \"19130448-4cdf-43d6-8da4-1fbbbb6621e5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:52.744544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:52.744451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:53.018391 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:53.018364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"]
Sep 15 13:47:53.020702 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:47:53.020654    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19130448_4cdf_43d6_8da4_1fbbbb6621e5.slice/crio-43dcf2888ed0fd979e2af6807d00da75679007c24c1e6d60880c520176481dfa WatchSource:0}: Error finding container 43dcf2888ed0fd979e2af6807d00da75679007c24c1e6d60880c520176481dfa: Status 404 returned error can't find the container with id 43dcf2888ed0fd979e2af6807d00da75679007c24c1e6d60880c520176481dfa
Sep 15 13:47:53.847750 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:53.847699    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68" event={"ID":"19130448-4cdf-43d6-8da4-1fbbbb6621e5","Type":"ContainerStarted","Data":"43dcf2888ed0fd979e2af6807d00da75679007c24c1e6d60880c520176481dfa"}
Sep 15 13:47:58.876085 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:58.876044    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68" event={"ID":"19130448-4cdf-43d6-8da4-1fbbbb6621e5","Type":"ContainerStarted","Data":"91d04800c858a09caa9bd064614d2143f03bbb639c03f4815906f3ee2d5280f9"}
Sep 15 13:47:58.876511 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:58.876123    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:47:58.902157 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:47:58.902101    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68" podStartSLOduration=2.037816967 podStartE2EDuration="6.902084806s" totalImagesPullingTime="4.864267839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:47:58.900387677 +0000 UTC m=+554.150048992" watchObservedRunningTime="2026-09-15 13:47:58.902084806 +0000 UTC m=+554.151746099"
Sep 15 13:48:04.909486 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:04.909453    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6bc68"
Sep 15 13:48:12.772463 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.772430    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:12.775938 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.775915    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:12.780071 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.780044    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 13:48:12.788204 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.788183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 13:48:12.790441 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.790423    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lb8r8\""
Sep 15 13:48:12.793361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.793287    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 13:48:12.796060 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.796040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:12.946034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.946000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:12.946200 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.946070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7rvl\" (UniqueName: \"kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:12.946200 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.946090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:12.956951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.956917    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 13:48:12.960430 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.960413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:12.971352 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:12.971328    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 13:48:13.046943 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.046841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7rvl\" (UniqueName: \"kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.046943 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.046882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.046943 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.046934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.047280 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:13.047079    2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 15 13:48:13.047280 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:13.047131    2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 15 13:48:13.047280 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:13.047172    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs podName:c49f4395-45bb-4b3f-a278-765aff312cee nodeName:}" failed. No retries permitted until 2026-09-15 13:48:13.547149746 +0000 UTC m=+568.796811019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs") pod "maas-controller-bf48cd9d-xc9k9" (UID: "c49f4395-45bb-4b3f-a278-765aff312cee") : secret "maas-controller-metrics-tls" not found
Sep 15 13:48:13.047280 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:13.047193    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert podName:c49f4395-45bb-4b3f-a278-765aff312cee nodeName:}" failed. No retries permitted until 2026-09-15 13:48:13.547183704 +0000 UTC m=+568.796844978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert") pod "maas-controller-bf48cd9d-xc9k9" (UID: "c49f4395-45bb-4b3f-a278-765aff312cee") : secret "maas-controller-webhook-cert" not found
Sep 15 13:48:13.058087 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.058061    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7rvl\" (UniqueName: \"kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.148371 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.148328    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82vb\" (UniqueName: \"kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.148371 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.148380    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.148593 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.148500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.249487 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.249451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.249720 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.249511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82vb\" (UniqueName: \"kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.249720 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.249555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.252042 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.252015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.252182 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.252097    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.258373 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.258342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82vb\" (UniqueName: \"kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb\") pod \"maas-controller-5745f64bd7-cmfrb\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") " pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.271489 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.271455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:13.545225 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.545191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 13:48:13.547588 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:48:13.547561    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c073604_cfa0_478f_95ea_d99cf882e620.slice/crio-124f9674089e5907fe163eeb98396559dc4d158f937dc27c207f4f6bac3e567b WatchSource:0}: Error finding container 124f9674089e5907fe163eeb98396559dc4d158f937dc27c207f4f6bac3e567b: Status 404 returned error can't find the container with id 124f9674089e5907fe163eeb98396559dc4d158f937dc27c207f4f6bac3e567b
Sep 15 13:48:13.552859 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.552833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.552960 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.552899    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.555175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.555150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.555293 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.555274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") pod \"maas-controller-bf48cd9d-xc9k9\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") " pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.686772 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.686735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:13.947526 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.947444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" event={"ID":"6c073604-cfa0-478f-95ea-d99cf882e620","Type":"ContainerStarted","Data":"124f9674089e5907fe163eeb98396559dc4d158f937dc27c207f4f6bac3e567b"}
Sep 15 13:48:13.966490 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:13.966446    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:13.973977 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:48:13.973949    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49f4395_45bb_4b3f_a278_765aff312cee.slice/crio-fd4ac92fe5e022c6b1b45aa743c64dfa6cdf49f04f6bb332ea4eda82f8dd9f62 WatchSource:0}: Error finding container fd4ac92fe5e022c6b1b45aa743c64dfa6cdf49f04f6bb332ea4eda82f8dd9f62: Status 404 returned error can't find the container with id fd4ac92fe5e022c6b1b45aa743c64dfa6cdf49f04f6bb332ea4eda82f8dd9f62
Sep 15 13:48:14.956544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:14.956463    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" event={"ID":"c49f4395-45bb-4b3f-a278-765aff312cee","Type":"ContainerStarted","Data":"fd4ac92fe5e022c6b1b45aa743c64dfa6cdf49f04f6bb332ea4eda82f8dd9f62"}
Sep 15 13:48:16.966908 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:16.966854    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" event={"ID":"6c073604-cfa0-478f-95ea-d99cf882e620","Type":"ContainerStarted","Data":"c053e5fb8aab558d87d6cf2157eea70ce281421243efacabe07bed0db7edc34f"}
Sep 15 13:48:16.967373 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:16.967019    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:16.968416 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:16.968391    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" event={"ID":"c49f4395-45bb-4b3f-a278-765aff312cee","Type":"ContainerStarted","Data":"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"}
Sep 15 13:48:16.968536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:16.968523    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:16.988137 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:16.988091    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" podStartSLOduration=2.305017397 podStartE2EDuration="4.988076469s" totalImagesPullingTime="2.683059072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:16.986427242 +0000 UTC m=+572.236088553" watchObservedRunningTime="2026-09-15 13:48:16.988076469 +0000 UTC m=+572.237737757"
Sep 15 13:48:27.976016 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:27.975984    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 13:48:27.976566 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:27.976054    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:27.994054 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:27.994002    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" podStartSLOduration=13.74885311 podStartE2EDuration="15.993986565s" totalImagesPullingTime="2.245133455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:17.016818191 +0000 UTC m=+572.266479481" watchObservedRunningTime="2026-09-15 13:48:27.993986565 +0000 UTC m=+583.243647874"
Sep 15 13:48:28.038769 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.038732    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:28.038990 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.038962    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" podUID="c49f4395-45bb-4b3f-a278-765aff312cee" containerName="manager" containerID="cri-o://5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0" gracePeriod=30
Sep 15 13:48:28.288806 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.288780    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:28.385733 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.385698    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") pod \"c49f4395-45bb-4b3f-a278-765aff312cee\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") "
Sep 15 13:48:28.385897 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.385745    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") pod \"c49f4395-45bb-4b3f-a278-765aff312cee\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") "
Sep 15 13:48:28.385897 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.385788    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7rvl\" (UniqueName: \"kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl\") pod \"c49f4395-45bb-4b3f-a278-765aff312cee\" (UID: \"c49f4395-45bb-4b3f-a278-765aff312cee\") "
Sep 15 13:48:28.387968 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.387933    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c49f4395-45bb-4b3f-a278-765aff312cee" (UID: "c49f4395-45bb-4b3f-a278-765aff312cee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:48:28.387968 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.387933    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl" (OuterVolumeSpecName: "kube-api-access-r7rvl") pod "c49f4395-45bb-4b3f-a278-765aff312cee" (UID: "c49f4395-45bb-4b3f-a278-765aff312cee"). InnerVolumeSpecName "kube-api-access-r7rvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:48:28.388136 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.388003    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c49f4395-45bb-4b3f-a278-765aff312cee" (UID: "c49f4395-45bb-4b3f-a278-765aff312cee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:48:28.487155 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.487117    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:48:28.487155 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.487155    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c49f4395-45bb-4b3f-a278-765aff312cee-webhook-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:48:28.487408 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:28.487170    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7rvl\" (UniqueName: \"kubernetes.io/projected/c49f4395-45bb-4b3f-a278-765aff312cee-kube-api-access-r7rvl\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:48:29.026451 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.026408    2584 generic.go:356] "Generic (PLEG): container finished" podID="c49f4395-45bb-4b3f-a278-765aff312cee" containerID="5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0" exitCode=0
Sep 15 13:48:29.026451 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.026451    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-xc9k9"
Sep 15 13:48:29.026887 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.026466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" event={"ID":"c49f4395-45bb-4b3f-a278-765aff312cee","Type":"ContainerDied","Data":"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"}
Sep 15 13:48:29.026887 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.026514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-xc9k9" event={"ID":"c49f4395-45bb-4b3f-a278-765aff312cee","Type":"ContainerDied","Data":"fd4ac92fe5e022c6b1b45aa743c64dfa6cdf49f04f6bb332ea4eda82f8dd9f62"}
Sep 15 13:48:29.026887 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.026538    2584 scope.go:117] "RemoveContainer" containerID="5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"
Sep 15 13:48:29.035553 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.035534    2584 scope.go:117] "RemoveContainer" containerID="5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"
Sep 15 13:48:29.035885 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:29.035866    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0\": container with ID starting with 5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0 not found: ID does not exist" containerID="5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"
Sep 15 13:48:29.035933 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.035897    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0"} err="failed to get container status \"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0\": rpc error: code = NotFound desc = could not find container \"5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0\": container with ID starting with 5ba4049cb8f83bfc62324410e4c82b3cfb744ab23518862e4ac02f1531082eb0 not found: ID does not exist"
Sep 15 13:48:29.046888 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.046853    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:29.051605 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.051578    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-xc9k9"]
Sep 15 13:48:29.262860 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:29.262829    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49f4395-45bb-4b3f-a278-765aff312cee" path="/var/lib/kubelet/pods/c49f4395-45bb-4b3f-a278-765aff312cee/volumes"
Sep 15 13:48:48.839249 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.839210    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"]
Sep 15 13:48:48.839685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.839586    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49f4395-45bb-4b3f-a278-765aff312cee" containerName="manager"
Sep 15 13:48:48.839685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.839598    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49f4395-45bb-4b3f-a278-765aff312cee" containerName="manager"
Sep 15 13:48:48.839685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.839676    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49f4395-45bb-4b3f-a278-765aff312cee" containerName="manager"
Sep 15 13:48:48.845917 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.845892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:48.848155 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.848123    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 13:48:48.848302 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.848169    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 13:48:48.848302 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.848178    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lkr7h\""
Sep 15 13:48:48.854624 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.854599    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"]
Sep 15 13:48:48.971778 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.971742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dfa4e7-6c84-44a4-b487-bc897d95b335-openshift-service-ca\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:48.971973 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.971791    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:48.971973 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.971842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-metrics-certs\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:48.971973 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:48.971884    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f477q\" (UniqueName: \"kubernetes.io/projected/23dfa4e7-6c84-44a4-b487-bc897d95b335-kube-api-access-f477q\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.072774 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.072729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-metrics-certs\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.072951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.072782    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f477q\" (UniqueName: \"kubernetes.io/projected/23dfa4e7-6c84-44a4-b487-bc897d95b335-kube-api-access-f477q\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.072951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.072900    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dfa4e7-6c84-44a4-b487-bc897d95b335-openshift-service-ca\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.072951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.072934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.073076 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:49.073031    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 15 13:48:49.073139 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:48:49.073124    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls podName:23dfa4e7-6c84-44a4-b487-bc897d95b335 nodeName:}" failed. No retries permitted until 2026-09-15 13:48:49.573103283 +0000 UTC m=+604.822764574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls") pod "maas-api-786fdf86ff-bzbx5" (UID: "23dfa4e7-6c84-44a4-b487-bc897d95b335") : secret "maas-api-serving-cert" not found
Sep 15 13:48:49.073656 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.073627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dfa4e7-6c84-44a4-b487-bc897d95b335-openshift-service-ca\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.075245 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.075223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-metrics-certs\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.084235 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.084203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f477q\" (UniqueName: \"kubernetes.io/projected/23dfa4e7-6c84-44a4-b487-bc897d95b335-kube-api-access-f477q\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.460216 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.460176    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"]
Sep 15 13:48:49.463932 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.463910    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.466475 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.466450    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 13:48:49.466610 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.466512    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8bl4v\""
Sep 15 13:48:49.473872 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.473845    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"]
Sep 15 13:48:49.568415 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.568381    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4d224"]
Sep 15 13:48:49.571999 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.571978    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.577498 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.577470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b6ff220-97c9-4141-a99a-9b3e76626694-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.577692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.577565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.577692 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.577610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9dz\" (UniqueName: \"kubernetes.io/projected/1b6ff220-97c9-4141-a99a-9b3e76626694-kube-api-access-ht9dz\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.581181 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.581159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dfa4e7-6c84-44a4-b487-bc897d95b335-maas-api-tls\") pod \"maas-api-786fdf86ff-bzbx5\" (UID: \"23dfa4e7-6c84-44a4-b487-bc897d95b335\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.581821 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.581793    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4d224"]
Sep 15 13:48:49.678963 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.678919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwdx\" (UniqueName: \"kubernetes.io/projected/13359e71-01fe-4d1c-97df-4f20f909f80a-kube-api-access-mvwdx\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.679157 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.678976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b6ff220-97c9-4141-a99a-9b3e76626694-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.679157 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.679064    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13359e71-01fe-4d1c-97df-4f20f909f80a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.679251 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.679171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9dz\" (UniqueName: \"kubernetes.io/projected/1b6ff220-97c9-4141-a99a-9b3e76626694-kube-api-access-ht9dz\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.679844 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.679825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b6ff220-97c9-4141-a99a-9b3e76626694-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.687779 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.687749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9dz\" (UniqueName: \"kubernetes.io/projected/1b6ff220-97c9-4141-a99a-9b3e76626694-kube-api-access-ht9dz\") pod \"payload-pre-processing-59fbc47bf8-nc9q7\" (UID: \"1b6ff220-97c9-4141-a99a-9b3e76626694\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.758387 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.758294    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:48:49.776662 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.776632    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:49.779646 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.779615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwdx\" (UniqueName: \"kubernetes.io/projected/13359e71-01fe-4d1c-97df-4f20f909f80a-kube-api-access-mvwdx\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.779817 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.779707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13359e71-01fe-4d1c-97df-4f20f909f80a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.780359 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.780339    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13359e71-01fe-4d1c-97df-4f20f909f80a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.787381 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.787347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwdx\" (UniqueName: \"kubernetes.io/projected/13359e71-01fe-4d1c-97df-4f20f909f80a-kube-api-access-mvwdx\") pod \"payload-processing-5b54b7fbb7-4d224\" (UID: \"13359e71-01fe-4d1c-97df-4f20f909f80a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:49.894452 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:49.894413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:50.036188 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:50.036161    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"]
Sep 15 13:48:50.038071 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:48:50.038046    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23dfa4e7_6c84_44a4_b487_bc897d95b335.slice/crio-8ef6d7ec3ba821861de3089927803d888d16f533e715897e6ecce89c75168fbd WatchSource:0}: Error finding container 8ef6d7ec3ba821861de3089927803d888d16f533e715897e6ecce89c75168fbd: Status 404 returned error can't find the container with id 8ef6d7ec3ba821861de3089927803d888d16f533e715897e6ecce89c75168fbd
Sep 15 13:48:50.060968 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:50.060940    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"]
Sep 15 13:48:50.063344 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:48:50.063311    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6ff220_97c9_4141_a99a_9b3e76626694.slice/crio-3b59433f7873a58c527f3ccac94caba083549853c9bb32b3e4ef156723e4f829 WatchSource:0}: Error finding container 3b59433f7873a58c527f3ccac94caba083549853c9bb32b3e4ef156723e4f829: Status 404 returned error can't find the container with id 3b59433f7873a58c527f3ccac94caba083549853c9bb32b3e4ef156723e4f829
Sep 15 13:48:50.126297 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:50.126252    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7" event={"ID":"1b6ff220-97c9-4141-a99a-9b3e76626694","Type":"ContainerStarted","Data":"3b59433f7873a58c527f3ccac94caba083549853c9bb32b3e4ef156723e4f829"}
Sep 15 13:48:50.127623 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:50.127577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5" event={"ID":"23dfa4e7-6c84-44a4-b487-bc897d95b335","Type":"ContainerStarted","Data":"8ef6d7ec3ba821861de3089927803d888d16f533e715897e6ecce89c75168fbd"}
Sep 15 13:48:50.168264 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:50.168236    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4d224"]
Sep 15 13:48:50.170620 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:48:50.170586    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13359e71_01fe_4d1c_97df_4f20f909f80a.slice/crio-ffe90016aef199066ce4c0d8db52a2a81dae029e275ae1db2d3cb0746c04225e WatchSource:0}: Error finding container ffe90016aef199066ce4c0d8db52a2a81dae029e275ae1db2d3cb0746c04225e: Status 404 returned error can't find the container with id ffe90016aef199066ce4c0d8db52a2a81dae029e275ae1db2d3cb0746c04225e
Sep 15 13:48:51.138889 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:51.138829    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224" event={"ID":"13359e71-01fe-4d1c-97df-4f20f909f80a","Type":"ContainerStarted","Data":"ffe90016aef199066ce4c0d8db52a2a81dae029e275ae1db2d3cb0746c04225e"}
Sep 15 13:48:52.147685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.147085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7" event={"ID":"1b6ff220-97c9-4141-a99a-9b3e76626694","Type":"ContainerStarted","Data":"0ddda976e53d7c9a7ca397e930f26d29f7dd3e1b236970e73211a8a2956d2b82"}
Sep 15 13:48:52.147685 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.147197    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:48:52.149496 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.149124    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224" event={"ID":"13359e71-01fe-4d1c-97df-4f20f909f80a","Type":"ContainerStarted","Data":"5ac7389b92fc4512dee04367a2dd14a5f78590ca7ef959bdac83a89572b7662f"}
Sep 15 13:48:52.149634 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.149620    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:48:52.166938 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.166860    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7" podStartSLOduration=1.5348454820000001 podStartE2EDuration="3.166837657s" totalImagesPullingTime="1.631992175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:52.164721398 +0000 UTC m=+607.414382704" watchObservedRunningTime="2026-09-15 13:48:52.166837657 +0000 UTC m=+607.416498952"
Sep 15 13:48:52.181243 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:52.181168    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224" podStartSLOduration=1.652514385 podStartE2EDuration="3.181145454s" totalImagesPullingTime="1.528631069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:52.180694723 +0000 UTC m=+607.430356047" watchObservedRunningTime="2026-09-15 13:48:52.181145454 +0000 UTC m=+607.430806754"
Sep 15 13:48:53.156283 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:53.156246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5" event={"ID":"23dfa4e7-6c84-44a4-b487-bc897d95b335","Type":"ContainerStarted","Data":"640b9b6becc639782cfc3bfe1e18cf7357ac3a0a4a81b750db11831e97b4c678"}
Sep 15 13:48:53.175390 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:53.175338    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5" podStartSLOduration=2.221685328 podStartE2EDuration="5.175317168s" totalImagesPullingTime="2.95363184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:48:53.174251977 +0000 UTC m=+608.423913281" watchObservedRunningTime="2026-09-15 13:48:53.175317168 +0000 UTC m=+608.424978462"
Sep 15 13:48:54.161081 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:48:54.161040    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:49:00.171463 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:00.171433    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-bzbx5"
Sep 15 13:49:03.159061 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:03.159029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7"
Sep 15 13:49:04.163719 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:04.163658    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-4d224"
Sep 15 13:49:11.321644 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.321549    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"]
Sep 15 13:49:11.326130 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.326098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.329546 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.329509    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 13:49:11.329710 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.329557    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 15 13:49:11.329710 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.329645    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 13:49:11.329840 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.329706    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mmvf\""
Sep 15 13:49:11.334583 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.334557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"]
Sep 15 13:49:11.375452 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fba2563-56cc-459d-bd72-06a7d51c8176-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.375624 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375479    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.375624 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.375624 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.375624 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.375794 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.375632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbgbx\" (UniqueName: \"kubernetes.io/projected/6fba2563-56cc-459d-bd72-06a7d51c8176-kube-api-access-sbgbx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476377 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fba2563-56cc-459d-bd72-06a7d51c8176-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbgbx\" (UniqueName: \"kubernetes.io/projected/6fba2563-56cc-459d-bd72-06a7d51c8176-kube-api-access-sbgbx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.476942 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.477023 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476962    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.477023 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.476988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.478807 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.478786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fba2563-56cc-459d-bd72-06a7d51c8176-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.479123 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.479105    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fba2563-56cc-459d-bd72-06a7d51c8176-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.490707 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.490630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbgbx\" (UniqueName: \"kubernetes.io/projected/6fba2563-56cc-459d-bd72-06a7d51c8176-kube-api-access-sbgbx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h\" (UID: \"6fba2563-56cc-459d-bd72-06a7d51c8176\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.639931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.639895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:11.916791 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.916758    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"]
Sep 15 13:49:11.919910 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:49:11.919882    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fba2563_56cc_459d_bd72_06a7d51c8176.slice/crio-76c56a7357d5c2c6fa24cc2d4d7348a9306c459f9ecdb10e2249c6b0f734ce71 WatchSource:0}: Error finding container 76c56a7357d5c2c6fa24cc2d4d7348a9306c459f9ecdb10e2249c6b0f734ce71: Status 404 returned error can't find the container with id 76c56a7357d5c2c6fa24cc2d4d7348a9306c459f9ecdb10e2249c6b0f734ce71
Sep 15 13:49:11.921326 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:11.921308    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:49:12.261114 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:12.261022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h" event={"ID":"6fba2563-56cc-459d-bd72-06a7d51c8176","Type":"ContainerStarted","Data":"76c56a7357d5c2c6fa24cc2d4d7348a9306c459f9ecdb10e2249c6b0f734ce71"}
Sep 15 13:49:13.267076 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:13.266983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h" event={"ID":"6fba2563-56cc-459d-bd72-06a7d51c8176","Type":"ContainerStarted","Data":"82c56feba6555113db29bc97291cef02402d25a6264a804b22b98ff6abc28de2"}
Sep 15 13:49:13.284602 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:13.284551    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h" podStartSLOduration=1.297983912 podStartE2EDuration="2.284532376s" totalImagesPullingTime="986.548464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:49:13.283239534 +0000 UTC m=+628.532900853" watchObservedRunningTime="2026-09-15 13:49:13.284532376 +0000 UTC m=+628.534193671"
Sep 15 13:49:21.640970 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:21.640926    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:21.641441 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:21.640996    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:21.653754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:21.653723    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:49:22.321938 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:49:22.321901    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h"
Sep 15 13:51:56.161295 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.161261    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"]
Sep 15 13:51:56.164897 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.164866    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.167328 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.167303    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-1293e7-serving-cert\""
Sep 15 13:51:56.179265 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.179235    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"]
Sep 15 13:51:56.210958 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.210908    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzkb\" (UniqueName: \"kubernetes.io/projected/e216822e-9c44-48b6-963b-5e74ca73d24b-kube-api-access-qhzkb\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.211170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.211066    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-metrics-certs\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.211170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.211094    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.211170 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.211117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e216822e-9c44-48b6-963b-5e74ca73d24b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.312302 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.312265    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-metrics-certs\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.312497 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.312324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.312497 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.312383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e216822e-9c44-48b6-963b-5e74ca73d24b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.312497 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.312442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzkb\" (UniqueName: \"kubernetes.io/projected/e216822e-9c44-48b6-963b-5e74ca73d24b-kube-api-access-qhzkb\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.312659 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:56.312534    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-serving-cert: secret "maas-api-e2e-worker-w0-1293e7-serving-cert" not found
Sep 15 13:51:56.312659 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:56.312611    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls podName:e216822e-9c44-48b6-963b-5e74ca73d24b nodeName:}" failed. No retries permitted until 2026-09-15 13:51:56.812589001 +0000 UTC m=+792.062250272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls") pod "maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv" (UID: "e216822e-9c44-48b6-963b-5e74ca73d24b") : secret "maas-api-e2e-worker-w0-1293e7-serving-cert" not found
Sep 15 13:51:56.313278 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.313254    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e216822e-9c44-48b6-963b-5e74ca73d24b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.315077 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.315041    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-metrics-certs\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.323175 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.323151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzkb\" (UniqueName: \"kubernetes.io/projected/e216822e-9c44-48b6-963b-5e74ca73d24b-kube-api-access-qhzkb\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.817167 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.817125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.819594 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.819569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e216822e-9c44-48b6-963b-5e74ca73d24b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv\" (UID: \"e216822e-9c44-48b6-963b-5e74ca73d24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:56.845992 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.845952    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"]
Sep 15 13:51:56.850310 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.850282    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:56.852478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.852455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-1293e7\""
Sep 15 13:51:56.860532 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.860500    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"]
Sep 15 13:51:56.888388 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.888344    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"]
Sep 15 13:51:56.892863 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.892835    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:56.895625 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.895597    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-1293e7-dockercfg-mkf4c\""
Sep 15 13:51:56.903527 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.903495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"]
Sep 15 13:51:56.917780 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.917738    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g7w\" (UniqueName: \"kubernetes.io/projected/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-kube-api-access-d4g7w\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:56.917969 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.917891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1afceb1-345d-443a-91b5-f2b8a61de5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:56.917969 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.917934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpc7h\" (UniqueName: \"kubernetes.io/projected/d1afceb1-345d-443a-91b5-f2b8a61de5eb-kube-api-access-mpc7h\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:56.918078 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:56.917988    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.018918 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.018880    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1afceb1-345d-443a-91b5-f2b8a61de5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:57.019102 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.018922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpc7h\" (UniqueName: \"kubernetes.io/projected/d1afceb1-345d-443a-91b5-f2b8a61de5eb-kube-api-access-mpc7h\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:57.019102 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.018982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.019102 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.019013    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g7w\" (UniqueName: \"kubernetes.io/projected/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-kube-api-access-d4g7w\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.019703 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.019653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1afceb1-345d-443a-91b5-f2b8a61de5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:57.019887 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.019869    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.027226 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.027193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpc7h\" (UniqueName: \"kubernetes.io/projected/d1afceb1-345d-443a-91b5-f2b8a61de5eb-kube-api-access-mpc7h\") pod \"payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq\" (UID: \"d1afceb1-345d-443a-91b5-f2b8a61de5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:57.027226 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.027213    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g7w\" (UniqueName: \"kubernetes.io/projected/cb15e7e7-1b78-4acf-bcf9-7ee815388d68-kube-api-access-d4g7w\") pod \"payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk\" (UID: \"cb15e7e7-1b78-4acf-bcf9-7ee815388d68\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.077446 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.077350    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:57.163218 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.163183    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:57.209700 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.209636    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:57.354946 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.354849    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"]
Sep 15 13:51:57.360509 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.360480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"]
Sep 15 13:51:57.360739 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.360720    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.362771 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:57.362741    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode216822e_9c44_48b6_963b_5e74ca73d24b.slice/crio-f14b9173d0e086e3363966a808349271035cd0f70e4b8151f03ed27173202524 WatchSource:0}: Error finding container f14b9173d0e086e3363966a808349271035cd0f70e4b8151f03ed27173202524: Status 404 returned error can't find the container with id f14b9173d0e086e3363966a808349271035cd0f70e4b8151f03ed27173202524
Sep 15 13:51:57.362959 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.362938    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-66261e-serving-cert\""
Sep 15 13:51:57.368349 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.368324    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"]
Sep 15 13:51:57.427204 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.427156    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.427406 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.427216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2pfw\" (UniqueName: \"kubernetes.io/projected/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-kube-api-access-j2pfw\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.427406 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.427297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.427406 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.427336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-metrics-certs\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.438368 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.438289    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"]
Sep 15 13:51:57.441179 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:57.441143    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1afceb1_345d_443a_91b5_f2b8a61de5eb.slice/crio-2eb7101bfdcb373a3fddc121700b1a0fbc887d67ad6e5c1d77d1c14b26761e80 WatchSource:0}: Error finding container 2eb7101bfdcb373a3fddc121700b1a0fbc887d67ad6e5c1d77d1c14b26761e80: Status 404 returned error can't find the container with id 2eb7101bfdcb373a3fddc121700b1a0fbc887d67ad6e5c1d77d1c14b26761e80
Sep 15 13:51:57.502756 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.502721    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"]
Sep 15 13:51:57.503632 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:57.503604    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb15e7e7_1b78_4acf_bcf9_7ee815388d68.slice/crio-31176ee58c17d0d247c76c15549eef7d42c40885e1a6380a75a6871bcd5a122a WatchSource:0}: Error finding container 31176ee58c17d0d247c76c15549eef7d42c40885e1a6380a75a6871bcd5a122a: Status 404 returned error can't find the container with id 31176ee58c17d0d247c76c15549eef7d42c40885e1a6380a75a6871bcd5a122a
Sep 15 13:51:57.527790 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.527765    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.527926 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.527821    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-metrics-certs\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.527926 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.527886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.527926 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.527915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2pfw\" (UniqueName: \"kubernetes.io/projected/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-kube-api-access-j2pfw\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.528042 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:57.527926    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-serving-cert: secret "maas-api-e2e-worker-w4-66261e-serving-cert" not found
Sep 15 13:51:57.528042 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:57.528004    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls podName:43309a39-0c4e-44f3-aeb1-c0bc15f38ca7 nodeName:}" failed. No retries permitted until 2026-09-15 13:51:58.027982217 +0000 UTC m=+793.277643497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls") pod "maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw" (UID: "43309a39-0c4e-44f3-aeb1-c0bc15f38ca7") : secret "maas-api-e2e-worker-w4-66261e-serving-cert" not found
Sep 15 13:51:57.528544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.528522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.530637 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.530613    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-metrics-certs\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:57.536423 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:57.536396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2pfw\" (UniqueName: \"kubernetes.io/projected/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-kube-api-access-j2pfw\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:58.032478 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.032373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:58.035699 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.035655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43309a39-0c4e-44f3-aeb1-c0bc15f38ca7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw\" (UID: \"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:58.079924 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.079882    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq" event={"ID":"d1afceb1-345d-443a-91b5-f2b8a61de5eb","Type":"ContainerStarted","Data":"bfba11274de7355f24d369515140c043839634a8a1ddbd47f9149e96f567bc9d"}
Sep 15 13:51:58.080102 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.079950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq" event={"ID":"d1afceb1-345d-443a-91b5-f2b8a61de5eb","Type":"ContainerStarted","Data":"2eb7101bfdcb373a3fddc121700b1a0fbc887d67ad6e5c1d77d1c14b26761e80"}
Sep 15 13:51:58.080396 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.080122    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:51:58.082232 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.082198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk" event={"ID":"cb15e7e7-1b78-4acf-bcf9-7ee815388d68","Type":"ContainerStarted","Data":"5bdb89283207c092241c6b5f982e3c09a8d0be35b502ba5424e1231f8d6e555d"}
Sep 15 13:51:58.082536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.082510    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk" event={"ID":"cb15e7e7-1b78-4acf-bcf9-7ee815388d68","Type":"ContainerStarted","Data":"31176ee58c17d0d247c76c15549eef7d42c40885e1a6380a75a6871bcd5a122a"}
Sep 15 13:51:58.082615 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.082560    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:51:58.084217 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.084190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv" event={"ID":"e216822e-9c44-48b6-963b-5e74ca73d24b","Type":"ContainerStarted","Data":"e8474afe1050581ee2c6e2212c0b7e1c537c23296004222cbf8aa079d84f43eb"}
Sep 15 13:51:58.084920 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.084238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv" event={"ID":"e216822e-9c44-48b6-963b-5e74ca73d24b","Type":"ContainerStarted","Data":"f14b9173d0e086e3363966a808349271035cd0f70e4b8151f03ed27173202524"}
Sep 15 13:51:58.084920 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.084295    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:51:58.105226 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.105165    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq" podStartSLOduration=2.105147058 podStartE2EDuration="2.105147058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:58.102400052 +0000 UTC m=+793.352061359" watchObservedRunningTime="2026-09-15 13:51:58.105147058 +0000 UTC m=+793.354808352"
Sep 15 13:51:58.124911 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.124846    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv" podStartSLOduration=1.766978027 podStartE2EDuration="2.124823796s" totalImagesPullingTime="357.845769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:58.123076468 +0000 UTC m=+793.372737787" watchObservedRunningTime="2026-09-15 13:51:58.124823796 +0000 UTC m=+793.374485092"
Sep 15 13:51:58.167073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.167012    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk" podStartSLOduration=2.166991191 podStartE2EDuration="2.166991191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:58.142970954 +0000 UTC m=+793.392632276" watchObservedRunningTime="2026-09-15 13:51:58.166991191 +0000 UTC m=+793.416652486"
Sep 15 13:51:58.168477 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.168454    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"]
Sep 15 13:51:58.172238 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.172214    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.174631 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.174607    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-66261e\""
Sep 15 13:51:58.174775 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.174758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-66261e-dockercfg-r44st\""
Sep 15 13:51:58.181243 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.180963    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"]
Sep 15 13:51:58.235034 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.234989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88bm\" (UniqueName: \"kubernetes.io/projected/ad4be6af-502d-4b2e-bf1a-c2655630b175-kube-api-access-b88bm\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.235266 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.235095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad4be6af-502d-4b2e-bf1a-c2655630b175-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.285107 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.285012    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:58.299734 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.299699    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"]
Sep 15 13:51:58.304699 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.303999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.333376 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.333341    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"]
Sep 15 13:51:58.338073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.336610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad4be6af-502d-4b2e-bf1a-c2655630b175-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.338073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.336720    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.338073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.336792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b88bm\" (UniqueName: \"kubernetes.io/projected/ad4be6af-502d-4b2e-bf1a-c2655630b175-kube-api-access-b88bm\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.338073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.336829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzsk\" (UniqueName: \"kubernetes.io/projected/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-kube-api-access-grzsk\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.338073 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.337743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad4be6af-502d-4b2e-bf1a-c2655630b175-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.368536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.368306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88bm\" (UniqueName: \"kubernetes.io/projected/ad4be6af-502d-4b2e-bf1a-c2655630b175-kube-api-access-b88bm\") pod \"payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964\" (UID: \"ad4be6af-502d-4b2e-bf1a-c2655630b175\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.437538 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.437490    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.437756 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.437576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grzsk\" (UniqueName: \"kubernetes.io/projected/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-kube-api-access-grzsk\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.438292 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.438269    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.447975 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.447936    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzsk\" (UniqueName: \"kubernetes.io/projected/a7ed4b8e-acee-4313-b138-18a8cb3e9f10-kube-api-access-grzsk\") pod \"payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7\" (UID: \"a7ed4b8e-acee-4313-b138-18a8cb3e9f10\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.486874 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.486834    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:58.513472 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.513437    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"]
Sep 15 13:51:58.517544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.517519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.520080 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.520041    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4441a1-serving-cert\""
Sep 15 13:51:58.527870 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.527820    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"]
Sep 15 13:51:58.540128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.539359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96667c44-0d7b-436e-bd02-fc39719169ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.540128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.539433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.540128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.539465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7kzh\" (UniqueName: \"kubernetes.io/projected/96667c44-0d7b-436e-bd02-fc39719169ca-kube-api-access-x7kzh\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.540128 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.539630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-metrics-certs\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.586325 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.586277    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"]
Sep 15 13:51:58.588132 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:58.588091    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43309a39_0c4e_44f3_aeb1_c0bc15f38ca7.slice/crio-7eee764a394a0f6fd44226da2c5d3e07e00d28c30413383eb9dca1ed22e4da30 WatchSource:0}: Error finding container 7eee764a394a0f6fd44226da2c5d3e07e00d28c30413383eb9dca1ed22e4da30: Status 404 returned error can't find the container with id 7eee764a394a0f6fd44226da2c5d3e07e00d28c30413383eb9dca1ed22e4da30
Sep 15 13:51:58.642247 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.642086    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:58.643035 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.642432    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96667c44-0d7b-436e-bd02-fc39719169ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.643150 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.643074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.643150 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.643108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7kzh\" (UniqueName: \"kubernetes.io/projected/96667c44-0d7b-436e-bd02-fc39719169ca-kube-api-access-x7kzh\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.643257 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.643194    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-metrics-certs\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.643257 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.643197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96667c44-0d7b-436e-bd02-fc39719169ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.643257 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:58.643229    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-serving-cert: secret "maas-api-e2e-inf-a-4441a1-serving-cert" not found
Sep 15 13:51:58.643409 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:51:58.643299    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls podName:96667c44-0d7b-436e-bd02-fc39719169ca nodeName:}" failed. No retries permitted until 2026-09-15 13:51:59.143280171 +0000 UTC m=+794.392941469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls") pod "maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b" (UID: "96667c44-0d7b-436e-bd02-fc39719169ca") : secret "maas-api-e2e-inf-a-4441a1-serving-cert" not found
Sep 15 13:51:58.645495 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.645477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-metrics-certs\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.652493 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.652468    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7kzh\" (UniqueName: \"kubernetes.io/projected/96667c44-0d7b-436e-bd02-fc39719169ca-kube-api-access-x7kzh\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:58.788361 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.788332    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"]
Sep 15 13:51:58.790414 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:58.790335    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4be6af_502d_4b2e_bf1a_c2655630b175.slice/crio-2518076f0815054365f716b78b75c007e29650a02f77826cd263fddf073de751 WatchSource:0}: Error finding container 2518076f0815054365f716b78b75c007e29650a02f77826cd263fddf073de751: Status 404 returned error can't find the container with id 2518076f0815054365f716b78b75c007e29650a02f77826cd263fddf073de751
Sep 15 13:51:58.924894 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:58.924824    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"]
Sep 15 13:51:58.927374 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:58.927339    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ed4b8e_acee_4313_b138_18a8cb3e9f10.slice/crio-305b86fb6b94f26f6c59c2a39fcd929950ea5514376a21d7844792d0c24f04ad WatchSource:0}: Error finding container 305b86fb6b94f26f6c59c2a39fcd929950ea5514376a21d7844792d0c24f04ad: Status 404 returned error can't find the container with id 305b86fb6b94f26f6c59c2a39fcd929950ea5514376a21d7844792d0c24f04ad
Sep 15 13:51:59.092269 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.092172    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw" event={"ID":"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7","Type":"ContainerStarted","Data":"96b24cc21c9803f0ea1f3b3c4daa2e58aaf3261ae1d76cd7b15ba11ecd0fd1d4"}
Sep 15 13:51:59.092269 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.092246    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:51:59.092474 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.092272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw" event={"ID":"43309a39-0c4e-44f3-aeb1-c0bc15f38ca7","Type":"ContainerStarted","Data":"7eee764a394a0f6fd44226da2c5d3e07e00d28c30413383eb9dca1ed22e4da30"}
Sep 15 13:51:59.093928 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.093903    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964" event={"ID":"ad4be6af-502d-4b2e-bf1a-c2655630b175","Type":"ContainerStarted","Data":"4ea0baf62a3c1a8c8cf3b7b70129390ed5bf4ad18e1cc4e1363cc2a121475fdd"}
Sep 15 13:51:59.094055 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.093946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964" event={"ID":"ad4be6af-502d-4b2e-bf1a-c2655630b175","Type":"ContainerStarted","Data":"2518076f0815054365f716b78b75c007e29650a02f77826cd263fddf073de751"}
Sep 15 13:51:59.094055 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.094019    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:51:59.095600 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.095574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7" event={"ID":"a7ed4b8e-acee-4313-b138-18a8cb3e9f10","Type":"ContainerStarted","Data":"84fb72c4323937e14262fdc9fd7f7df0c3e4de971aeeb7739e3478af991b2355"}
Sep 15 13:51:59.095725 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.095623    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7" event={"ID":"a7ed4b8e-acee-4313-b138-18a8cb3e9f10","Type":"ContainerStarted","Data":"305b86fb6b94f26f6c59c2a39fcd929950ea5514376a21d7844792d0c24f04ad"}
Sep 15 13:51:59.095931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.095911    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:51:59.116963 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.116899    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw" podStartSLOduration=1.816152453 podStartE2EDuration="2.116878221s" totalImagesPullingTime="300.725768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:59.113943162 +0000 UTC m=+794.363604484" watchObservedRunningTime="2026-09-15 13:51:59.116878221 +0000 UTC m=+794.366539518"
Sep 15 13:51:59.134436 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.134159    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7" podStartSLOduration=1.134126446 podStartE2EDuration="1.134126446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:59.133378789 +0000 UTC m=+794.383040082" watchObservedRunningTime="2026-09-15 13:51:59.134126446 +0000 UTC m=+794.383787747"
Sep 15 13:51:59.149922 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.149882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:59.153690 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.153597    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964" podStartSLOduration=1.153573695 podStartE2EDuration="1.153573695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:51:59.152214084 +0000 UTC m=+794.401875394" watchObservedRunningTime="2026-09-15 13:51:59.153573695 +0000 UTC m=+794.403234989"
Sep 15 13:51:59.155564 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.155533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96667c44-0d7b-436e-bd02-fc39719169ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b\" (UID: \"96667c44-0d7b-436e-bd02-fc39719169ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:59.279456 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.279410    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"]
Sep 15 13:51:59.283263 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.283239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.285477 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.285446    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4441a1\""
Sep 15 13:51:59.285605 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.285588    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-4441a1-dockercfg-4lvwn\""
Sep 15 13:51:59.293136 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.293108    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"]
Sep 15 13:51:59.351985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.351891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9b8f\" (UniqueName: \"kubernetes.io/projected/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-kube-api-access-m9b8f\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.351985 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.351961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.442106 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.442068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:51:59.454311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.453273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9b8f\" (UniqueName: \"kubernetes.io/projected/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-kube-api-access-m9b8f\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.454311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.453366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.454311 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.454263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.462527 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.462498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9b8f\" (UniqueName: \"kubernetes.io/projected/66f95b44-31a7-4ba6-8902-3d2ec2a8f971-kube-api-access-m9b8f\") pod \"payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb\" (UID: \"66f95b44-31a7-4ba6-8902-3d2ec2a8f971\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.596328 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.596291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:51:59.722994 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.722967    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"]
Sep 15 13:51:59.725478 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:59.725447    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96667c44_0d7b_436e_bd02_fc39719169ca.slice/crio-150c8555f0c98eca80e05a3f2870010ceab903a025a8433708dca2fd7b53f9fd WatchSource:0}: Error finding container 150c8555f0c98eca80e05a3f2870010ceab903a025a8433708dca2fd7b53f9fd: Status 404 returned error can't find the container with id 150c8555f0c98eca80e05a3f2870010ceab903a025a8433708dca2fd7b53f9fd
Sep 15 13:51:59.874190 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:51:59.874164    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"]
Sep 15 13:51:59.876314 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:51:59.876288    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f95b44_31a7_4ba6_8902_3d2ec2a8f971.slice/crio-f3c992c2011a32101eee4122de2165fa1a3978bcd61d1797c0a887aa0f2a4f83 WatchSource:0}: Error finding container f3c992c2011a32101eee4122de2165fa1a3978bcd61d1797c0a887aa0f2a4f83: Status 404 returned error can't find the container with id f3c992c2011a32101eee4122de2165fa1a3978bcd61d1797c0a887aa0f2a4f83
Sep 15 13:52:00.104777 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.104723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b" event={"ID":"96667c44-0d7b-436e-bd02-fc39719169ca","Type":"ContainerStarted","Data":"722c64deacad3d9904b60ce3bb328995bd14ed6bb0f2c72adfbb9ac8a592e62f"}
Sep 15 13:52:00.104979 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.104798    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b" event={"ID":"96667c44-0d7b-436e-bd02-fc39719169ca","Type":"ContainerStarted","Data":"150c8555f0c98eca80e05a3f2870010ceab903a025a8433708dca2fd7b53f9fd"}
Sep 15 13:52:00.105075 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.105047    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:52:00.107797 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.107304    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb" event={"ID":"66f95b44-31a7-4ba6-8902-3d2ec2a8f971","Type":"ContainerStarted","Data":"6782cd148ae990841355f02b62da26683df3a8d5722596233de3a531290703aa"}
Sep 15 13:52:00.107797 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.107760    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:52:00.108020 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.107812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb" event={"ID":"66f95b44-31a7-4ba6-8902-3d2ec2a8f971","Type":"ContainerStarted","Data":"f3c992c2011a32101eee4122de2165fa1a3978bcd61d1797c0a887aa0f2a4f83"}
Sep 15 13:52:00.131444 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.130301    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b" podStartSLOduration=1.840933097 podStartE2EDuration="2.130278392s" totalImagesPullingTime="289.345295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:00.128358059 +0000 UTC m=+795.378019377" watchObservedRunningTime="2026-09-15 13:52:00.130278392 +0000 UTC m=+795.379939689"
Sep 15 13:52:00.147424 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:00.147363    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb" podStartSLOduration=1.147346348 podStartE2EDuration="1.147346348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:00.1453108 +0000 UTC m=+795.394972373" watchObservedRunningTime="2026-09-15 13:52:00.147346348 +0000 UTC m=+795.397007689"
Sep 15 13:52:04.101849 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:04.101817    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv"
Sep 15 13:52:05.113095 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.113066    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw"
Sep 15 13:52:05.667334 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.667301    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:05.672405 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.672376    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.675127 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.675079    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8e248304-serving-cert\""
Sep 15 13:52:05.682264 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.682235    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:05.721564 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.721492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.721769 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.721572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.721769 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.721744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.721856 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.721825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kfc\" (UniqueName: \"kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.822922 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.822875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.822922 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.822922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.823185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.822981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.823185 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.823010    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44kfc\" (UniqueName: \"kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.823185 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:52:05.823102    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-serving-cert: secret "maas-api-e2e-ait-8e248304-serving-cert" not found
Sep 15 13:52:05.823185 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:52:05.823185    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls podName:31cc9b5c-c3d4-4a48-8045-6b83030e3270 nodeName:}" failed. No retries permitted until 2026-09-15 13:52:06.323167288 +0000 UTC m=+801.572828560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls") pod "maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270") : secret "maas-api-e2e-ait-8e248304-serving-cert" not found
Sep 15 13:52:05.823774 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.823750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.825450 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.825420    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:05.831222 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:05.831198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kfc\" (UniqueName: \"kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:06.121151 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.121077    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b"
Sep 15 13:52:06.329854 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.329808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:06.330011 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:52:06.329962    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-serving-cert: secret "maas-api-e2e-ait-8e248304-serving-cert" not found
Sep 15 13:52:06.330078 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:52:06.330027    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls podName:31cc9b5c-c3d4-4a48-8045-6b83030e3270 nodeName:}" failed. No retries permitted until 2026-09-15 13:52:07.33001116 +0000 UTC m=+802.579672431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls") pod "maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270") : secret "maas-api-e2e-ait-8e248304-serving-cert" not found
Sep 15 13:52:06.377351 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.377262    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:06.381658 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.381628    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.384874 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.384846    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8e248304-dockercfg-nrq5j\""
Sep 15 13:52:06.385043 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.384849    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8e248304\""
Sep 15 13:52:06.391635 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.391539    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:06.431422 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.431380    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88vq\" (UniqueName: \"kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.431621 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.431578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.533258 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.533221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88vq\" (UniqueName: \"kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.533466 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.533346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.534167 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.534139    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.544733 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.544701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88vq\" (UniqueName: \"kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq\") pod \"payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.696611 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.696573    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:06.975450 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:06.975373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:06.978863 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:52:06.978835    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93138ac_9307_4b90_b042_44fcea6f5dc2.slice/crio-d0817b4a7e2bc31581ccb7927193b2e86fa9ba9529567d6b573f334b77ff7c86 WatchSource:0}: Error finding container d0817b4a7e2bc31581ccb7927193b2e86fa9ba9529567d6b573f334b77ff7c86: Status 404 returned error can't find the container with id d0817b4a7e2bc31581ccb7927193b2e86fa9ba9529567d6b573f334b77ff7c86
Sep 15 13:52:07.151188 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.151150    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" event={"ID":"a93138ac-9307-4b90-b042-44fcea6f5dc2","Type":"ContainerStarted","Data":"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"}
Sep 15 13:52:07.151574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.151214    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:07.151574 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.151239    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" event={"ID":"a93138ac-9307-4b90-b042-44fcea6f5dc2","Type":"ContainerStarted","Data":"d0817b4a7e2bc31581ccb7927193b2e86fa9ba9529567d6b573f334b77ff7c86"}
Sep 15 13:52:07.167289 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.167236    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" podStartSLOduration=1.167219282 podStartE2EDuration="1.167219282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:07.166932937 +0000 UTC m=+802.416594251" watchObservedRunningTime="2026-09-15 13:52:07.167219282 +0000 UTC m=+802.416880576"
Sep 15 13:52:07.339767 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.339647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:07.342247 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.342213    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:07.489351 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.489315    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:07.766932 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:07.766890    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:07.769343 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:52:07.769314    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cc9b5c_c3d4_4a48_8045_6b83030e3270.slice/crio-5c5b11804779b4e7355c0e8a9d9351459418ac26fc9fafa7d160bdfca5b4ee8c WatchSource:0}: Error finding container 5c5b11804779b4e7355c0e8a9d9351459418ac26fc9fafa7d160bdfca5b4ee8c: Status 404 returned error can't find the container with id 5c5b11804779b4e7355c0e8a9d9351459418ac26fc9fafa7d160bdfca5b4ee8c
Sep 15 13:52:08.158482 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.158447    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" event={"ID":"31cc9b5c-c3d4-4a48-8045-6b83030e3270","Type":"ContainerStarted","Data":"5c5b11804779b4e7355c0e8a9d9351459418ac26fc9fafa7d160bdfca5b4ee8c"}
Sep 15 13:52:08.480406 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.480324    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:52:08.484256 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.484235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.487010 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.486978    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-80a7cc\""
Sep 15 13:52:08.487145 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.487040    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-80a7cc-dockercfg-w2bjx\""
Sep 15 13:52:08.496775 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.496746    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:52:08.552495 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.552212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88ks\" (UniqueName: \"kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.552495 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.552416    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.653642 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.653573    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.653891 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.653711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88ks\" (UniqueName: \"kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.654384 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.654359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.662256 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.662229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88ks\" (UniqueName: \"kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks\") pod \"payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") " pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:08.795717 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:08.795581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:09.074284 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.074255    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:52:09.075882 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:52:09.075850    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fd6b6a_c2b0_4f9f_9ab7_9e83566d8918.slice/crio-497a659032335072da92fb51bc2fe9de79a97d778f2a4bab1422f868d20dcc24 WatchSource:0}: Error finding container 497a659032335072da92fb51bc2fe9de79a97d778f2a4bab1422f868d20dcc24: Status 404 returned error can't find the container with id 497a659032335072da92fb51bc2fe9de79a97d778f2a4bab1422f868d20dcc24
Sep 15 13:52:09.098398 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.098371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk"
Sep 15 13:52:09.098572 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.098554    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq"
Sep 15 13:52:09.168860 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.168824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" event={"ID":"31cc9b5c-c3d4-4a48-8045-6b83030e3270","Type":"ContainerStarted","Data":"a425676336aa8f336929b755d4039f815a5b5db61dc4d50844c7233e11053c28"}
Sep 15 13:52:09.169684 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.169640    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:09.171346 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.171318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" event={"ID":"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918","Type":"ContainerStarted","Data":"497a659032335072da92fb51bc2fe9de79a97d778f2a4bab1422f868d20dcc24"}
Sep 15 13:52:09.191308 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:09.191242    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" podStartSLOduration=3.763999188 podStartE2EDuration="4.191219409s" totalImagesPullingTime="427.220221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:09.189014861 +0000 UTC m=+804.438676216" watchObservedRunningTime="2026-09-15 13:52:09.191219409 +0000 UTC m=+804.440880705"
Sep 15 13:52:10.109510 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:10.109477    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964"
Sep 15 13:52:10.178753 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:10.178701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" event={"ID":"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918","Type":"ContainerStarted","Data":"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"}
Sep 15 13:52:10.179243 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:10.178847    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:10.201498 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:10.201440    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" podStartSLOduration=2.201421685 podStartE2EDuration="2.201421685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:10.200085403 +0000 UTC m=+805.449746712" watchObservedRunningTime="2026-09-15 13:52:10.201421685 +0000 UTC m=+805.451082979"
Sep 15 13:52:11.117688 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:11.117634    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7"
Sep 15 13:52:12.123302 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:12.123268    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb"
Sep 15 13:52:16.190029 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:16.190001    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:18.161192 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:18.161161    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:20.201231 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.201181    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"]
Sep 15 13:52:20.205683 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.205643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.208736 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.208707    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2aa332\""
Sep 15 13:52:20.208863 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.208707    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2aa332-dockercfg-wjlv2\""
Sep 15 13:52:20.218536 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.218503    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"]
Sep 15 13:52:20.377825 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.377784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.378005 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.377835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bntx\" (UniqueName: \"kubernetes.io/projected/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-kube-api-access-9bntx\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.479246 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.479148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.479246 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.479202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bntx\" (UniqueName: \"kubernetes.io/projected/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-kube-api-access-9bntx\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.479942 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.479916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.487195 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.487166    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bntx\" (UniqueName: \"kubernetes.io/projected/f7e80c74-eb20-465b-a443-a9d8e9fa45b3-kube-api-access-9bntx\") pod \"payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8\" (UID: \"f7e80c74-eb20-465b-a443-a9d8e9fa45b3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.517201 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.517162    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:20.793627 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:20.793593    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"]
Sep 15 13:52:20.795077 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:52:20.795049    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e80c74_eb20_465b_a443_a9d8e9fa45b3.slice/crio-7d8e54cf1f227abafe5724d4e0a9309bed3581af915fc7d3950c4df1e14db432 WatchSource:0}: Error finding container 7d8e54cf1f227abafe5724d4e0a9309bed3581af915fc7d3950c4df1e14db432: Status 404 returned error can't find the container with id 7d8e54cf1f227abafe5724d4e0a9309bed3581af915fc7d3950c4df1e14db432
Sep 15 13:52:21.186614 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:21.186585    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:52:21.250014 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:21.249962    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8" event={"ID":"f7e80c74-eb20-465b-a443-a9d8e9fa45b3","Type":"ContainerStarted","Data":"4551d5b598d1054ca67a8c30ed1b3b907f39093bdfc4f61a79e13654bd8e2c8f"}
Sep 15 13:52:21.250419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:21.250027    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8" event={"ID":"f7e80c74-eb20-465b-a443-a9d8e9fa45b3","Type":"ContainerStarted","Data":"7d8e54cf1f227abafe5724d4e0a9309bed3581af915fc7d3950c4df1e14db432"}
Sep 15 13:52:21.250419 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:21.250108    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:21.272108 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:21.272043    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8" podStartSLOduration=1.272018102 podStartE2EDuration="1.272018102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:52:21.270232018 +0000 UTC m=+816.519893312" watchObservedRunningTime="2026-09-15 13:52:21.272018102 +0000 UTC m=+816.521679400"
Sep 15 13:52:32.258041 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:32.258005    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8"
Sep 15 13:52:34.145998 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.145955    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:34.146374 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.146241    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" podUID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" containerName="maas-api" containerID="cri-o://a425676336aa8f336929b755d4039f815a5b5db61dc4d50844c7233e11053c28" gracePeriod=30
Sep 15 13:52:34.214150 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.214111    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:34.214412 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.214380    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" podUID="a93138ac-9307-4b90-b042-44fcea6f5dc2" containerName="payload-pre-processing" containerID="cri-o://572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084" gracePeriod=30
Sep 15 13:52:34.332619 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.332589    2584 generic.go:356] "Generic (PLEG): container finished" podID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" containerID="a425676336aa8f336929b755d4039f815a5b5db61dc4d50844c7233e11053c28" exitCode=0
Sep 15 13:52:34.332816 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.332681    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" event={"ID":"31cc9b5c-c3d4-4a48-8045-6b83030e3270","Type":"ContainerDied","Data":"a425676336aa8f336929b755d4039f815a5b5db61dc4d50844c7233e11053c28"}
Sep 15 13:52:34.481641 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.481606    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:34.526154 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.526117    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs\") pod \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") "
Sep 15 13:52:34.526426 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.526401    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44kfc\" (UniqueName: \"kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc\") pod \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") "
Sep 15 13:52:34.526766 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.526743    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca\") pod \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") "
Sep 15 13:52:34.527248 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.527184    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31cc9b5c-c3d4-4a48-8045-6b83030e3270" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:52:34.527906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.527512    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") pod \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\" (UID: \"31cc9b5c-c3d4-4a48-8045-6b83030e3270\") "
Sep 15 13:52:34.528544 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.528525    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31cc9b5c-c3d4-4a48-8045-6b83030e3270-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.528951 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.528920    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:34.533070 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.533018    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31cc9b5c-c3d4-4a48-8045-6b83030e3270" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:52:34.533070 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.533044    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31cc9b5c-c3d4-4a48-8045-6b83030e3270" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:52:34.534423 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.534393    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc" (OuterVolumeSpecName: "kube-api-access-44kfc") pod "31cc9b5c-c3d4-4a48-8045-6b83030e3270" (UID: "31cc9b5c-c3d4-4a48-8045-6b83030e3270"). InnerVolumeSpecName "kube-api-access-44kfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:34.631931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.631889    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z88vq\" (UniqueName: \"kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq\") pod \"a93138ac-9307-4b90-b042-44fcea6f5dc2\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") "
Sep 15 13:52:34.632140 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.631956    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume\") pod \"a93138ac-9307-4b90-b042-44fcea6f5dc2\" (UID: \"a93138ac-9307-4b90-b042-44fcea6f5dc2\") "
Sep 15 13:52:34.632429 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.632407    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44kfc\" (UniqueName: \"kubernetes.io/projected/31cc9b5c-c3d4-4a48-8045-6b83030e3270-kube-api-access-44kfc\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.632538 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.632433    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.632538 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.632488    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31cc9b5c-c3d4-4a48-8045-6b83030e3270-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.632754 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.632716    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a93138ac-9307-4b90-b042-44fcea6f5dc2" (UID: "a93138ac-9307-4b90-b042-44fcea6f5dc2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:52:34.634837 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.634812    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq" (OuterVolumeSpecName: "kube-api-access-z88vq") pod "a93138ac-9307-4b90-b042-44fcea6f5dc2" (UID: "a93138ac-9307-4b90-b042-44fcea6f5dc2"). InnerVolumeSpecName "kube-api-access-z88vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:52:34.733228 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.733140    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z88vq\" (UniqueName: \"kubernetes.io/projected/a93138ac-9307-4b90-b042-44fcea6f5dc2-kube-api-access-z88vq\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:34.733228 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:34.733176    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a93138ac-9307-4b90-b042-44fcea6f5dc2-plugins-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:52:35.339448 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.339416    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"
Sep 15 13:52:35.339448 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.339440    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw" event={"ID":"31cc9b5c-c3d4-4a48-8045-6b83030e3270","Type":"ContainerDied","Data":"5c5b11804779b4e7355c0e8a9d9351459418ac26fc9fafa7d160bdfca5b4ee8c"}
Sep 15 13:52:35.339983 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.339510    2584 scope.go:117] "RemoveContainer" containerID="a425676336aa8f336929b755d4039f815a5b5db61dc4d50844c7233e11053c28"
Sep 15 13:52:35.341007 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.340841    2584 generic.go:356] "Generic (PLEG): container finished" podID="a93138ac-9307-4b90-b042-44fcea6f5dc2" containerID="572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084" exitCode=0
Sep 15 13:52:35.341007 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.340890    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"
Sep 15 13:52:35.341007 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.340928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" event={"ID":"a93138ac-9307-4b90-b042-44fcea6f5dc2","Type":"ContainerDied","Data":"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"}
Sep 15 13:52:35.341007 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.340970    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c" event={"ID":"a93138ac-9307-4b90-b042-44fcea6f5dc2","Type":"ContainerDied","Data":"d0817b4a7e2bc31581ccb7927193b2e86fa9ba9529567d6b573f334b77ff7c86"}
Sep 15 13:52:35.349417 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.349392    2584 scope.go:117] "RemoveContainer" containerID="572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"
Sep 15 13:52:35.358750 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.358721    2584 scope.go:117] "RemoveContainer" containerID="572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"
Sep 15 13:52:35.359124 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:52:35.359102    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084\": container with ID starting with 572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084 not found: ID does not exist" containerID="572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"
Sep 15 13:52:35.359195 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.359133    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084"} err="failed to get container status \"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084\": rpc error: code = NotFound desc = could not find container \"572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084\": container with ID starting with 572111f17ab87d041b1b29b14bb9464ed957379d46015c48a5d4ea9813920084 not found: ID does not exist"
Sep 15 13:52:35.362977 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.362942    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:35.374076 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.374045    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e248304-bfc4f5bb6-tx6zw"]
Sep 15 13:52:35.390881 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.390844    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:35.396863 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:35.396831    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c"]
Sep 15 13:52:37.264291 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:37.264257    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" path="/var/lib/kubelet/pods/31cc9b5c-c3d4-4a48-8045-6b83030e3270/volumes"
Sep 15 13:52:37.264687 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:52:37.264637    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a93138ac-9307-4b90-b042-44fcea6f5dc2" path="/var/lib/kubelet/pods/a93138ac-9307-4b90-b042-44fcea6f5dc2/volumes"
Sep 15 13:54:41.439697 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.439649    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:54:41.442421 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.439891    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" podUID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" containerName="payload-processing" containerID="cri-o://33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed" gracePeriod=30
Sep 15 13:54:41.719182 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.719152    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:54:41.801945 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.801909    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z88ks\" (UniqueName: \"kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks\") pod \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") "
Sep 15 13:54:41.802106 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.802057    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume\") pod \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\" (UID: \"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918\") "
Sep 15 13:54:41.802465 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.802440    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" (UID: "00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:54:41.804078 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.804047    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks" (OuterVolumeSpecName: "kube-api-access-z88ks") pod "00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" (UID: "00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918"). InnerVolumeSpecName "kube-api-access-z88ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:54:41.903799 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.903754    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z88ks\" (UniqueName: \"kubernetes.io/projected/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-kube-api-access-z88ks\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:54:41.903799 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:41.903787    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918-plugins-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:54:42.014931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.014844    2584 generic.go:356] "Generic (PLEG): container finished" podID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" containerID="33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed" exitCode=0
Sep 15 13:54:42.014931 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.014889    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"
Sep 15 13:54:42.015169 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.014940    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" event={"ID":"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918","Type":"ContainerDied","Data":"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"}
Sep 15 13:54:42.015169 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.014999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz" event={"ID":"00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918","Type":"ContainerDied","Data":"497a659032335072da92fb51bc2fe9de79a97d778f2a4bab1422f868d20dcc24"}
Sep 15 13:54:42.015169 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.015032    2584 scope.go:117] "RemoveContainer" containerID="33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"
Sep 15 13:54:42.027906 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.027874    2584 scope.go:117] "RemoveContainer" containerID="33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"
Sep 15 13:54:42.028429 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:54:42.028395    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed\": container with ID starting with 33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed not found: ID does not exist" containerID="33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"
Sep 15 13:54:42.028539 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.028437    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed"} err="failed to get container status \"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed\": rpc error: code = NotFound desc = could not find container \"33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed\": container with ID starting with 33eb76e580fab181ba36eb549e0f8cc964450aa39990ceb709c31062f96fcbed not found: ID does not exist"
Sep 15 13:54:42.043064 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.043028    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:54:42.047121 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:42.047096    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz"]
Sep 15 13:54:43.263610 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:54:43.263562    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" path="/var/lib/kubelet/pods/00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918/volumes"
Sep 15 13:55:31.373809 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.373774    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374221    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93138ac-9307-4b90-b042-44fcea6f5dc2" containerName="payload-pre-processing"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374233    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93138ac-9307-4b90-b042-44fcea6f5dc2" containerName="payload-pre-processing"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374244    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" containerName="maas-api"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374250    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" containerName="maas-api"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374266    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" containerName="payload-processing"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374271    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" containerName="payload-processing"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374379    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a93138ac-9307-4b90-b042-44fcea6f5dc2" containerName="payload-pre-processing"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374398    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="31cc9b5c-c3d4-4a48-8045-6b83030e3270" containerName="maas-api"
Sep 15 13:55:31.374454 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.374407    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="00fd6b6a-c2b0-4f9f-9ab7-9e83566d8918" containerName="payload-processing"
Sep 15 13:55:31.377761 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.377735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.384120 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.383732    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f9e4ef-serving-cert\""
Sep 15 13:55:31.388318 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.387812    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:55:31.489166 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.489122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.489331 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.489289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.489406 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.489391    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.489530 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.489505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd98k\" (UniqueName: \"kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.590638 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.590598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd98k\" (UniqueName: \"kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.590869 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.590678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.590869 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.590706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.590869 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.590730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.590869 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:55:31.590857    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-serving-cert: secret "maas-api-e2e-explicit-f9e4ef-serving-cert" not found
Sep 15 13:55:31.591077 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:55:31.590940    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls podName:5b1e0534-182f-48d4-94de-a86dcbb174f8 nodeName:}" failed. No retries permitted until 2026-09-15 13:55:32.090921039 +0000 UTC m=+1007.340582319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls") pod "maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" (UID: "5b1e0534-182f-48d4-94de-a86dcbb174f8") : secret "maas-api-e2e-explicit-f9e4ef-serving-cert" not found
Sep 15 13:55:31.591316 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.591298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.593143 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.593124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:31.604564 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:31.604534    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd98k\" (UniqueName: \"kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:32.095643 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:32.095602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:32.098179 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:32.098154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") pod \"maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:32.293096 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:32.293049    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:32.569581 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:32.569550    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:55:32.572023 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:55:32.571993    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1e0534_182f_48d4_94de_a86dcbb174f8.slice/crio-cd917a1b710eea4f67c6fb72bab1d4b1c18dbaf07a6fda07e096ed0172a259fb WatchSource:0}: Error finding container cd917a1b710eea4f67c6fb72bab1d4b1c18dbaf07a6fda07e096ed0172a259fb: Status 404 returned error can't find the container with id cd917a1b710eea4f67c6fb72bab1d4b1c18dbaf07a6fda07e096ed0172a259fb
Sep 15 13:55:32.573661 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:32.573638    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:55:33.282885 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:33.282853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" event={"ID":"5b1e0534-182f-48d4-94de-a86dcbb174f8","Type":"ContainerStarted","Data":"cd917a1b710eea4f67c6fb72bab1d4b1c18dbaf07a6fda07e096ed0172a259fb"}
Sep 15 13:55:35.303094 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:35.303062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" event={"ID":"5b1e0534-182f-48d4-94de-a86dcbb174f8","Type":"ContainerStarted","Data":"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"}
Sep 15 13:55:35.303503 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:35.303175    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:55:35.322874 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:35.322817    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" podStartSLOduration=2.361650372 podStartE2EDuration="4.322800267s" totalImagesPullingTime="1.961149895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:55:35.320361724 +0000 UTC m=+1010.570023036" watchObservedRunningTime="2026-09-15 13:55:35.322800267 +0000 UTC m=+1010.572461606"
Sep 15 13:55:41.314874 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:55:41.314840    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:57:21.268941 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.268904    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:57:21.269488 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.269154    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerName="maas-api" containerID="cri-o://320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91" gracePeriod=30
Sep 15 13:57:21.309298 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.309258    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.47:8443/health\": dial tcp 10.134.0.47:8443: connect: connection refused"
Sep 15 13:57:21.542971 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.542942    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:57:21.594014 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.593981    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd98k\" (UniqueName: \"kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k\") pod \"5b1e0534-182f-48d4-94de-a86dcbb174f8\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") "
Sep 15 13:57:21.594014 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.594029    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca\") pod \"5b1e0534-182f-48d4-94de-a86dcbb174f8\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") "
Sep 15 13:57:21.594346 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.594087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") pod \"5b1e0534-182f-48d4-94de-a86dcbb174f8\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") "
Sep 15 13:57:21.594346 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.594152    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs\") pod \"5b1e0534-182f-48d4-94de-a86dcbb174f8\" (UID: \"5b1e0534-182f-48d4-94de-a86dcbb174f8\") "
Sep 15 13:57:21.594550 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.594465    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b1e0534-182f-48d4-94de-a86dcbb174f8" (UID: "5b1e0534-182f-48d4-94de-a86dcbb174f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:57:21.596659 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.596583    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5b1e0534-182f-48d4-94de-a86dcbb174f8" (UID: "5b1e0534-182f-48d4-94de-a86dcbb174f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:57:21.596821 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.596735    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k" (OuterVolumeSpecName: "kube-api-access-xd98k") pod "5b1e0534-182f-48d4-94de-a86dcbb174f8" (UID: "5b1e0534-182f-48d4-94de-a86dcbb174f8"). InnerVolumeSpecName "kube-api-access-xd98k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:57:21.596955 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.596921    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b1e0534-182f-48d4-94de-a86dcbb174f8" (UID: "5b1e0534-182f-48d4-94de-a86dcbb174f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:57:21.698587 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.697315    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd98k\" (UniqueName: \"kubernetes.io/projected/5b1e0534-182f-48d4-94de-a86dcbb174f8-kube-api-access-xd98k\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.698587 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.697363    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1e0534-182f-48d4-94de-a86dcbb174f8-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.698587 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.697377    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.698587 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.697390    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1e0534-182f-48d4-94de-a86dcbb174f8-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 13:57:21.870342 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.870258    2584 generic.go:356] "Generic (PLEG): container finished" podID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerID="320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91" exitCode=0
Sep 15 13:57:21.870342 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.870304    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"
Sep 15 13:57:21.870519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.870340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" event={"ID":"5b1e0534-182f-48d4-94de-a86dcbb174f8","Type":"ContainerDied","Data":"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"}
Sep 15 13:57:21.870519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.870396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n" event={"ID":"5b1e0534-182f-48d4-94de-a86dcbb174f8","Type":"ContainerDied","Data":"cd917a1b710eea4f67c6fb72bab1d4b1c18dbaf07a6fda07e096ed0172a259fb"}
Sep 15 13:57:21.870519 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.870418    2584 scope.go:117] "RemoveContainer" containerID="320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"
Sep 15 13:57:21.880297 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.880278    2584 scope.go:117] "RemoveContainer" containerID="320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"
Sep 15 13:57:21.880612 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:57:21.880592    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91\": container with ID starting with 320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91 not found: ID does not exist" containerID="320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"
Sep 15 13:57:21.880675 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.880621    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91"} err="failed to get container status \"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91\": rpc error: code = NotFound desc = could not find container \"320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91\": container with ID starting with 320dfb62c9e6b428c43954b2e45a3cfc379d010b16f21859c69ac1ca2fe8ad91 not found: ID does not exist"
Sep 15 13:57:21.900580 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.900546    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:57:21.912923 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:21.912886    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f9e4ef-86987d8bcf-dtk5n"]
Sep 15 13:57:23.263981 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:57:23.263948    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" path="/var/lib/kubelet/pods/5b1e0534-182f-48d4-94de-a86dcbb174f8/volumes"
Sep 15 13:59:57.766571 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.766538    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 13:59:57.767716 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.767689    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerName="maas-api"
Sep 15 13:59:57.767716 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.767715    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerName="maas-api"
Sep 15 13:59:57.767953 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.767856    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1e0534-182f-48d4-94de-a86dcbb174f8" containerName="maas-api"
Sep 15 13:59:57.771159 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.771134    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.773457 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.773430    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-14c2563f-serving-cert\""
Sep 15 13:59:57.783793 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.783767    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 13:59:57.842305 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.842271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.842486 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.842338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.842486 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.842447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.842578 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.842484    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbd5q\" (UniqueName: \"kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.943104 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.943063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.943277 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.943116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbd5q\" (UniqueName: \"kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.943277 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.943150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.943277 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:59:57.943197    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-serving-cert: secret "maas-api-e2e-mt-14c2563f-serving-cert" not found
Sep 15 13:59:57.943277 ip-10-0-134-169 kubenswrapper[2584]: E0915 13:59:57.943275    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls podName:e11af1c5-2870-415e-9784-ee303011c70a nodeName:}" failed. No retries permitted until 2026-09-15 13:59:58.443254389 +0000 UTC m=+1273.692915661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls") pod "maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" (UID: "e11af1c5-2870-415e-9784-ee303011c70a") : secret "maas-api-e2e-mt-14c2563f-serving-cert" not found
Sep 15 13:59:57.943469 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.943375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.943958 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.943938    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.945599 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.945577    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:57.954910 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:57.954882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbd5q\" (UniqueName: \"kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:58.448418 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:58.448375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:58.450891 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:58.450866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") pod \"maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:58.683515 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:58.683474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:58.961054 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:58.960983    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 13:59:58.963532 ip-10-0-134-169 kubenswrapper[2584]: W0915 13:59:58.963503    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11af1c5_2870_415e_9784_ee303011c70a.slice/crio-cfb38a651317f630a84945596fcc5df138881aad324411a807cc36d3a58f30a6 WatchSource:0}: Error finding container cfb38a651317f630a84945596fcc5df138881aad324411a807cc36d3a58f30a6: Status 404 returned error can't find the container with id cfb38a651317f630a84945596fcc5df138881aad324411a807cc36d3a58f30a6
Sep 15 13:59:59.720993 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:59.720956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" event={"ID":"e11af1c5-2870-415e-9784-ee303011c70a","Type":"ContainerStarted","Data":"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"}
Sep 15 13:59:59.721177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:59.721038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" event={"ID":"e11af1c5-2870-415e-9784-ee303011c70a","Type":"ContainerStarted","Data":"cfb38a651317f630a84945596fcc5df138881aad324411a807cc36d3a58f30a6"}
Sep 15 13:59:59.721177 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:59.721129    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 13:59:59.740002 ip-10-0-134-169 kubenswrapper[2584]: I0915 13:59:59.739940    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" podStartSLOduration=2.386101757 podStartE2EDuration="2.739922407s" totalImagesPullingTime="353.82065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:59:59.737241351 +0000 UTC m=+1274.986902686" watchObservedRunningTime="2026-09-15 13:59:59.739922407 +0000 UTC m=+1274.989583700"
Sep 15 14:00:05.731973 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:05.731944    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 14:00:37.885986 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:37.885947    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 14:00:37.886536 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:37.886242    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" podUID="e11af1c5-2870-415e-9784-ee303011c70a" containerName="maas-api" containerID="cri-o://2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996" gracePeriod=30
Sep 15 14:00:38.151636 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.151566    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 14:00:38.249985 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.249939    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") pod \"e11af1c5-2870-415e-9784-ee303011c70a\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") "
Sep 15 14:00:38.250187 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.250141    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs\") pod \"e11af1c5-2870-415e-9784-ee303011c70a\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") "
Sep 15 14:00:38.250187 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.250171    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbd5q\" (UniqueName: \"kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q\") pod \"e11af1c5-2870-415e-9784-ee303011c70a\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") "
Sep 15 14:00:38.250312 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.250210    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca\") pod \"e11af1c5-2870-415e-9784-ee303011c70a\" (UID: \"e11af1c5-2870-415e-9784-ee303011c70a\") "
Sep 15 14:00:38.250845 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.250800    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e11af1c5-2870-415e-9784-ee303011c70a" (UID: "e11af1c5-2870-415e-9784-ee303011c70a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:00:38.252201 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.252174    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e11af1c5-2870-415e-9784-ee303011c70a" (UID: "e11af1c5-2870-415e-9784-ee303011c70a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:00:38.252333 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.252298    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e11af1c5-2870-415e-9784-ee303011c70a" (UID: "e11af1c5-2870-415e-9784-ee303011c70a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:00:38.252535 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.252516    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q" (OuterVolumeSpecName: "kube-api-access-wbd5q") pod "e11af1c5-2870-415e-9784-ee303011c70a" (UID: "e11af1c5-2870-415e-9784-ee303011c70a"). InnerVolumeSpecName "kube-api-access-wbd5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:00:38.351510 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.351472    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.351510 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.351504    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbd5q\" (UniqueName: \"kubernetes.io/projected/e11af1c5-2870-415e-9784-ee303011c70a-kube-api-access-wbd5q\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.351510 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.351515    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11af1c5-2870-415e-9784-ee303011c70a-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.351768 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.351524    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11af1c5-2870-415e-9784-ee303011c70a-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:00:38.929555 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.929519    2584 generic.go:356] "Generic (PLEG): container finished" podID="e11af1c5-2870-415e-9784-ee303011c70a" containerID="2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996" exitCode=0
Sep 15 14:00:38.930050 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.929574    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"
Sep 15 14:00:38.930050 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.929608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" event={"ID":"e11af1c5-2870-415e-9784-ee303011c70a","Type":"ContainerDied","Data":"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"}
Sep 15 14:00:38.930050 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.929676    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn" event={"ID":"e11af1c5-2870-415e-9784-ee303011c70a","Type":"ContainerDied","Data":"cfb38a651317f630a84945596fcc5df138881aad324411a807cc36d3a58f30a6"}
Sep 15 14:00:38.930050 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.929692    2584 scope.go:117] "RemoveContainer" containerID="2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"
Sep 15 14:00:38.939997 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.939981    2584 scope.go:117] "RemoveContainer" containerID="2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"
Sep 15 14:00:38.940322 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:00:38.940303    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996\": container with ID starting with 2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996 not found: ID does not exist" containerID="2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"
Sep 15 14:00:38.940366 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.940331    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996"} err="failed to get container status \"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996\": rpc error: code = NotFound desc = could not find container \"2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996\": container with ID starting with 2c6f0c054889c257c4716a29ff3876e7feb92a6cbf121d7bcee912b6e4f24996 not found: ID does not exist"
Sep 15 14:00:38.953345 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.953309    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 14:00:38.957094 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:38.957066    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-14c2563f-5fc97c5fdf-dwjmn"]
Sep 15 14:00:39.263575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:00:39.263486    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e11af1c5-2870-415e-9784-ee303011c70a" path="/var/lib/kubelet/pods/e11af1c5-2870-415e-9784-ee303011c70a/volumes"
Sep 15 14:01:04.722310 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.722272    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:01:04.722959 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.722939    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11af1c5-2870-415e-9784-ee303011c70a" containerName="maas-api"
Sep 15 14:01:04.723049 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.722961    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11af1c5-2870-415e-9784-ee303011c70a" containerName="maas-api"
Sep 15 14:01:04.723105 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.723090    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e11af1c5-2870-415e-9784-ee303011c70a" containerName="maas-api"
Sep 15 14:01:04.727790 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.727768    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.730907 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.730883    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-583e9a-serving-cert\""
Sep 15 14:01:04.761852 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.761821    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:01:04.816894 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.816849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.816894 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.816894    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.817117 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.816970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwjnr\" (UniqueName: \"kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.817117 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.817056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.918588 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.918553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwjnr\" (UniqueName: \"kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.918760 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.918628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.918760 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.918683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.918760 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.918707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.918966 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:01:04.918885    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-serving-cert: secret "maas-api-e2e-shared-a-w2-583e9a-serving-cert" not found
Sep 15 14:01:04.919015 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:01:04.918979    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls podName:b288b1ee-1e2d-424d-ba41-680d903ec8d9 nodeName:}" failed. No retries permitted until 2026-09-15 14:01:05.418955218 +0000 UTC m=+1340.668616508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls") pod "maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" (UID: "b288b1ee-1e2d-424d-ba41-680d903ec8d9") : secret "maas-api-e2e-shared-a-w2-583e9a-serving-cert" not found
Sep 15 14:01:04.919304 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.919282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.921701 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.921652    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:04.937943 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:04.937907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwjnr\" (UniqueName: \"kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:05.424934 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:05.424898    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:05.427353 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:05.427327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:05.638555 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:05.638477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:05.927526 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:05.927499    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:01:05.929793 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:01:05.929750    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb288b1ee_1e2d_424d_ba41_680d903ec8d9.slice/crio-5c8ddccee5b009af92b236f68c0b6ff86c9998c2aec5e489a14566eb5c396daf WatchSource:0}: Error finding container 5c8ddccee5b009af92b236f68c0b6ff86c9998c2aec5e489a14566eb5c396daf: Status 404 returned error can't find the container with id 5c8ddccee5b009af92b236f68c0b6ff86c9998c2aec5e489a14566eb5c396daf
Sep 15 14:01:05.931161 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:05.931145    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 14:01:06.074820 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:06.074733    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" event={"ID":"b288b1ee-1e2d-424d-ba41-680d903ec8d9","Type":"ContainerStarted","Data":"5c8ddccee5b009af92b236f68c0b6ff86c9998c2aec5e489a14566eb5c396daf"}
Sep 15 14:01:11.107209 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:11.107119    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" event={"ID":"b288b1ee-1e2d-424d-ba41-680d903ec8d9","Type":"ContainerStarted","Data":"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"}
Sep 15 14:01:11.107603 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:11.107343    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:11.129224 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:11.129167    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" podStartSLOduration=2.2412324789999998 podStartE2EDuration="7.129149828s" totalImagesPullingTime="4.887917349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:11.126050865 +0000 UTC m=+1346.375712183" watchObservedRunningTime="2026-09-15 14:01:11.129149828 +0000 UTC m=+1346.378811122"
Sep 15 14:01:17.117733 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:17.117696    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:01:32.210102 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.210065    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:01:32.214045 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.214018    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.216788 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.216761    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-4bb7b3-dockercfg-ncm5f\""
Sep 15 14:01:32.216942 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.216919    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-4bb7b3\""
Sep 15 14:01:32.224961 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.224929    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:01:32.228961 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.228935    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.230320 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.230296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:01:32.247981 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.247951    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:01:32.291813 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.291773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.291813 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.291818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncvz\" (UniqueName: \"kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.292026 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.291926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfh9\" (UniqueName: \"kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.292026 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.291962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.393440 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.393397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfh9\" (UniqueName: \"kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.393622 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.393472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.393622 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.393527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.393622 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.393569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncvz\" (UniqueName: \"kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.394248 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.394222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.394359 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.394305    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.402242 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.402217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncvz\" (UniqueName: \"kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz\") pod \"payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.402356 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.402285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfh9\" (UniqueName: \"kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9\") pod \"payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.526293 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.526205    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:32.542733 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.542705    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:32.807590 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.807563    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:01:32.809869 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:01:32.809836    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77764c20_3269_45cb_8842_4451929fe8a1.slice/crio-672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530 WatchSource:0}: Error finding container 672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530: Status 404 returned error can't find the container with id 672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530
Sep 15 14:01:32.834598 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:32.834572    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:01:32.840901 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:01:32.840873    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d6844e_1a0c_4f86_a9dd_7332d9f2aaba.slice/crio-702793579a01d37998288b1714c26d3d73aadda563c70d3869926653b377704a WatchSource:0}: Error finding container 702793579a01d37998288b1714c26d3d73aadda563c70d3869926653b377704a: Status 404 returned error can't find the container with id 702793579a01d37998288b1714c26d3d73aadda563c70d3869926653b377704a
Sep 15 14:01:33.228315 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.228273    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" event={"ID":"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba","Type":"ContainerStarted","Data":"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"}
Sep 15 14:01:33.228831 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.228373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" event={"ID":"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba","Type":"ContainerStarted","Data":"702793579a01d37998288b1714c26d3d73aadda563c70d3869926653b377704a"}
Sep 15 14:01:33.228831 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.228498    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:33.230202 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.230174    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" event={"ID":"77764c20-3269-45cb-8842-4451929fe8a1","Type":"ContainerStarted","Data":"8e8ea84abbb4b4e866cb4613e11d5954bbc21f3e1101e48cdee0f8d95483b6b6"}
Sep 15 14:01:33.230332 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.230229    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" event={"ID":"77764c20-3269-45cb-8842-4451929fe8a1","Type":"ContainerStarted","Data":"672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530"}
Sep 15 14:01:33.230332 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.230263    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:01:33.248414 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.248344    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" podStartSLOduration=1.248320806 podStartE2EDuration="1.248320806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:33.245187784 +0000 UTC m=+1368.494849106" watchObservedRunningTime="2026-09-15 14:01:33.248320806 +0000 UTC m=+1368.497982103"
Sep 15 14:01:33.265700 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:33.265623    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" podStartSLOduration=1.265606429 podStartE2EDuration="1.265606429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:01:33.262903392 +0000 UTC m=+1368.512564713" watchObservedRunningTime="2026-09-15 14:01:33.265606429 +0000 UTC m=+1368.515267755"
Sep 15 14:01:44.238742 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:44.238702    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:01:44.239243 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:01:44.238773    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:02:11.826491 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.826441    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:02:11.834146 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.833704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.837534 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.837507    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5842bc8c-serving-cert\""
Sep 15 14:02:11.845871 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.845845    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:02:11.896873 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.896829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6np\" (UniqueName: \"kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.896873 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.896875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.897153 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.896902    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.897153 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.896963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.998204 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.998160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6np\" (UniqueName: \"kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.998204 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.998205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.998433 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.998229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.998433 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.998270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:11.998433 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:02:11.998392    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-serving-cert: secret "maas-api-e2e-mt-5842bc8c-serving-cert" not found
Sep 15 14:02:11.998553 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:02:11.998473    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls podName:c15979d7-c5c1-481f-b48a-0c72f811a996 nodeName:}" failed. No retries permitted until 2026-09-15 14:02:12.498455863 +0000 UTC m=+1407.748117135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls") pod "maas-api-e2e-mt-5842bc8c-849886d744-b96ds" (UID: "c15979d7-c5c1-481f-b48a-0c72f811a996") : secret "maas-api-e2e-mt-5842bc8c-serving-cert" not found
Sep 15 14:02:11.999080 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:11.999060    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:12.000819 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:12.000798    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:12.006899 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:12.006875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6np\" (UniqueName: \"kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:12.503910 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:12.503878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:12.506552 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:12.506518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") pod \"maas-api-e2e-mt-5842bc8c-849886d744-b96ds\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:12.750522 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:12.750476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:13.031731 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:13.031697    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:02:13.033954 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:02:13.033920    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15979d7_c5c1_481f_b48a_0c72f811a996.slice/crio-6e5051c00e8465bb1641188f4b68461c8604a6ccb9a6e650c7fc324f61d51cb8 WatchSource:0}: Error finding container 6e5051c00e8465bb1641188f4b68461c8604a6ccb9a6e650c7fc324f61d51cb8: Status 404 returned error can't find the container with id 6e5051c00e8465bb1641188f4b68461c8604a6ccb9a6e650c7fc324f61d51cb8
Sep 15 14:02:13.464584 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:13.464547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" event={"ID":"c15979d7-c5c1-481f-b48a-0c72f811a996","Type":"ContainerStarted","Data":"6e5051c00e8465bb1641188f4b68461c8604a6ccb9a6e650c7fc324f61d51cb8"}
Sep 15 14:02:14.471607 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:14.471568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" event={"ID":"c15979d7-c5c1-481f-b48a-0c72f811a996","Type":"ContainerStarted","Data":"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"}
Sep 15 14:02:14.472023 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:14.471648    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:02:14.491148 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:14.491082    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" podStartSLOduration=3.009386439 podStartE2EDuration="3.491065422s" totalImagesPullingTime="481.678983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:02:14.488825128 +0000 UTC m=+1409.738486436" watchObservedRunningTime="2026-09-15 14:02:14.491065422 +0000 UTC m=+1409.740726717"
Sep 15 14:02:20.483382 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:02:20.483349    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:06:34.866330 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:34.866292    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:06:34.866880 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:34.866568    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" podUID="c15979d7-c5c1-481f-b48a-0c72f811a996" containerName="maas-api" containerID="cri-o://c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b" gracePeriod=30
Sep 15 14:06:35.135463 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.135435    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:06:35.246390 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.246356    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") pod \"c15979d7-c5c1-481f-b48a-0c72f811a996\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") "
Sep 15 14:06:35.246595 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.246399    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj6np\" (UniqueName: \"kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np\") pod \"c15979d7-c5c1-481f-b48a-0c72f811a996\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") "
Sep 15 14:06:35.246595 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.246439    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca\") pod \"c15979d7-c5c1-481f-b48a-0c72f811a996\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") "
Sep 15 14:06:35.246595 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.246497    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs\") pod \"c15979d7-c5c1-481f-b48a-0c72f811a996\" (UID: \"c15979d7-c5c1-481f-b48a-0c72f811a996\") "
Sep 15 14:06:35.246886 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.246856    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c15979d7-c5c1-481f-b48a-0c72f811a996" (UID: "c15979d7-c5c1-481f-b48a-0c72f811a996"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:06:35.248916 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.248881    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np" (OuterVolumeSpecName: "kube-api-access-jj6np") pod "c15979d7-c5c1-481f-b48a-0c72f811a996" (UID: "c15979d7-c5c1-481f-b48a-0c72f811a996"). InnerVolumeSpecName "kube-api-access-jj6np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:06:35.249101 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.249078    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c15979d7-c5c1-481f-b48a-0c72f811a996" (UID: "c15979d7-c5c1-481f-b48a-0c72f811a996"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:06:35.249172 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.249095    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c15979d7-c5c1-481f-b48a-0c72f811a996" (UID: "c15979d7-c5c1-481f-b48a-0c72f811a996"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:06:35.348483 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.348435    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15979d7-c5c1-481f-b48a-0c72f811a996-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.348483 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.348478    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.348483 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.348494    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15979d7-c5c1-481f-b48a-0c72f811a996-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.348822 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.348507    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj6np\" (UniqueName: \"kubernetes.io/projected/c15979d7-c5c1-481f-b48a-0c72f811a996-kube-api-access-jj6np\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:06:35.910094 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.910057    2584 generic.go:356] "Generic (PLEG): container finished" podID="c15979d7-c5c1-481f-b48a-0c72f811a996" containerID="c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b" exitCode=0
Sep 15 14:06:35.910519 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.910106    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"
Sep 15 14:06:35.910519 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.910135    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" event={"ID":"c15979d7-c5c1-481f-b48a-0c72f811a996","Type":"ContainerDied","Data":"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"}
Sep 15 14:06:35.910519 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.910192    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds" event={"ID":"c15979d7-c5c1-481f-b48a-0c72f811a996","Type":"ContainerDied","Data":"6e5051c00e8465bb1641188f4b68461c8604a6ccb9a6e650c7fc324f61d51cb8"}
Sep 15 14:06:35.910519 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.910214    2584 scope.go:117] "RemoveContainer" containerID="c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"
Sep 15 14:06:35.919836 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.919813    2584 scope.go:117] "RemoveContainer" containerID="c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"
Sep 15 14:06:35.920212 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:06:35.920193    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b\": container with ID starting with c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b not found: ID does not exist" containerID="c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"
Sep 15 14:06:35.920263 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.920222    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b"} err="failed to get container status \"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b\": rpc error: code = NotFound desc = could not find container \"c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b\": container with ID starting with c63dbabd74931a73422cd970e0ed0d4ab8c598b4166f22c110c91c3029785f5b not found: ID does not exist"
Sep 15 14:06:35.932807 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.932773    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:06:35.944130 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:35.944095    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5842bc8c-849886d744-b96ds"]
Sep 15 14:06:37.264386 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:06:37.264356    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c15979d7-c5c1-481f-b48a-0c72f811a996" path="/var/lib/kubelet/pods/c15979d7-c5c1-481f-b48a-0c72f811a996/volumes"
Sep 15 14:08:09.001128 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.001089    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:08:09.001702 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.001683    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15979d7-c5c1-481f-b48a-0c72f811a996" containerName="maas-api"
Sep 15 14:08:09.001702 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.001703    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15979d7-c5c1-481f-b48a-0c72f811a996" containerName="maas-api"
Sep 15 14:08:09.001813 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.001805    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15979d7-c5c1-481f-b48a-0c72f811a996" containerName="maas-api"
Sep 15 14:08:09.004948 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.004932    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.007411 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.007386    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-a090a0-dockercfg-b6646\""
Sep 15 14:08:09.007546 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.007389    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-a090a0\""
Sep 15 14:08:09.015315 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.015284    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:08:09.071280 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.071246    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.071490 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.071383    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx877\" (UniqueName: \"kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.172469 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.172404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.172655 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.172494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx877\" (UniqueName: \"kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.173370 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.173346    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.181727 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.181702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx877\" (UniqueName: \"kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877\") pod \"payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.317888 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.317802    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:09.592972 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:09.592941    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:08:09.594587 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:08:09.594560    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cd9a0d_8429_4e7b_832b_a1a7580f31e2.slice/crio-fd85c806aace7d15475660fa68de302a7aeba58bed995286e834ac38c3373c5c WatchSource:0}: Error finding container fd85c806aace7d15475660fa68de302a7aeba58bed995286e834ac38c3373c5c: Status 404 returned error can't find the container with id fd85c806aace7d15475660fa68de302a7aeba58bed995286e834ac38c3373c5c
Sep 15 14:08:10.418026 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:10.417982    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" event={"ID":"01cd9a0d-8429-4e7b-832b-a1a7580f31e2","Type":"ContainerStarted","Data":"47a0bccbe8a8b93713717e81f9423220cffd3889682231c999793be7cbf1a35e"}
Sep 15 14:08:10.418431 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:10.418046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" event={"ID":"01cd9a0d-8429-4e7b-832b-a1a7580f31e2","Type":"ContainerStarted","Data":"fd85c806aace7d15475660fa68de302a7aeba58bed995286e834ac38c3373c5c"}
Sep 15 14:08:10.418431 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:10.418074    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:08:10.436884 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:10.436834    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" podStartSLOduration=2.43681595 podStartE2EDuration="2.43681595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:08:10.435407481 +0000 UTC m=+1765.685068797" watchObservedRunningTime="2026-09-15 14:08:10.43681595 +0000 UTC m=+1765.686477245"
Sep 15 14:08:21.426216 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:08:21.426180    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:13:25.429983 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.429946    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:13:25.433951 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.433928    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.436339 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.436319    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-746f54-serving-cert\""
Sep 15 14:13:25.446254 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.446028    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:13:25.540485 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.540445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.540713 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.540518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.540713 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.540584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.540713 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.540622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hqw\" (UniqueName: \"kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.641509 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.641471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.641509 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.641517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hqw\" (UniqueName: \"kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.641509 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.641565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.641947 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.641729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.642822 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.642749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.645062 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.645007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.645245 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.645223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.650701 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.650649    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hqw\" (UniqueName: \"kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw\") pod \"maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:25.748248 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:25.748160    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:26.028575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:26.028534    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:13:26.029994 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:13:26.029966    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1eac2f_d61f_40e1_85a4_3bf92eb14b97.slice/crio-9b80760b47f625df1cb5c6194f6d61e06ef0f5fef8d9f3f174ff84764d9a80e6 WatchSource:0}: Error finding container 9b80760b47f625df1cb5c6194f6d61e06ef0f5fef8d9f3f174ff84764d9a80e6: Status 404 returned error can't find the container with id 9b80760b47f625df1cb5c6194f6d61e06ef0f5fef8d9f3f174ff84764d9a80e6
Sep 15 14:13:26.031492 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:26.031472    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 14:13:26.140456 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:26.140420    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" event={"ID":"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97","Type":"ContainerStarted","Data":"9b80760b47f625df1cb5c6194f6d61e06ef0f5fef8d9f3f174ff84764d9a80e6"}
Sep 15 14:13:27.147295 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:27.147257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" event={"ID":"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97","Type":"ContainerStarted","Data":"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"}
Sep 15 14:13:27.147708 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:27.147389    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:27.169887 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:27.169836    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" podStartSLOduration=1.6667310039999998 podStartE2EDuration="2.169818522s" totalImagesPullingTime="503.087518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:27.168148047 +0000 UTC m=+2082.417809353" watchObservedRunningTime="2026-09-15 14:13:27.169818522 +0000 UTC m=+2082.419479855"
Sep 15 14:13:33.158564 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:33.158532    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:13:49.154048 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.154010    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:13:49.159599 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.159570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.164352 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.164065    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e50cdb-serving-cert\""
Sep 15 14:13:49.170789 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.170757    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:13:49.279570 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.279533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.279794 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.279589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.279892 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.279798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.279892 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.279846    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtlsv\" (UniqueName: \"kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.380780 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.380739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.380966 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.380795    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.380966 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.380869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.380966 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.380903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlsv\" (UniqueName: \"kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.381603 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.381575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.383270 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.383245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.383368 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.383284    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.389955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.389928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtlsv\" (UniqueName: \"kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv\") pod \"maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.478123 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.478031    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:49.757847 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:49.757811    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:13:49.759074 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:13:49.759040    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dfeef9_faca_4ff2_9e61_77b48121cb03.slice/crio-65c1ba14a6d56822f01c9b80c122dc885c0f97f934abcdd460be5bcef7024df8 WatchSource:0}: Error finding container 65c1ba14a6d56822f01c9b80c122dc885c0f97f934abcdd460be5bcef7024df8: Status 404 returned error can't find the container with id 65c1ba14a6d56822f01c9b80c122dc885c0f97f934abcdd460be5bcef7024df8
Sep 15 14:13:50.291065 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:50.291024    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" event={"ID":"27dfeef9-faca-4ff2-9e61-77b48121cb03","Type":"ContainerStarted","Data":"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"}
Sep 15 14:13:50.291582 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:50.291089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" event={"ID":"27dfeef9-faca-4ff2-9e61-77b48121cb03","Type":"ContainerStarted","Data":"65c1ba14a6d56822f01c9b80c122dc885c0f97f934abcdd460be5bcef7024df8"}
Sep 15 14:13:50.291582 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:50.291140    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:13:50.312444 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:50.312347    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" podStartSLOduration=1.025087508 podStartE2EDuration="1.312325389s" totalImagesPullingTime="287.237881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:13:50.311088329 +0000 UTC m=+2105.560749642" watchObservedRunningTime="2026-09-15 14:13:50.312325389 +0000 UTC m=+2105.561986683"
Sep 15 14:13:56.302627 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:13:56.302592    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:14:33.507343 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.507308    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:14:33.507933 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.507540    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" podUID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" containerName="maas-api" containerID="cri-o://70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645" gracePeriod=30
Sep 15 14:14:33.774690 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.774601    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:14:33.933695 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.932226    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs\") pod \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") "
Sep 15 14:14:33.933695 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.932364    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls\") pod \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") "
Sep 15 14:14:33.933695 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.932452    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca\") pod \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") "
Sep 15 14:14:33.933695 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.932480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6hqw\" (UniqueName: \"kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw\") pod \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\" (UID: \"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97\") "
Sep 15 14:14:33.937601 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.937527    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" (UID: "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:33.942001 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.941960    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw" (OuterVolumeSpecName: "kube-api-access-c6hqw") pod "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" (UID: "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97"). InnerVolumeSpecName "kube-api-access-c6hqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:33.942178 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.941976    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" (UID: "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:14:33.943409 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:33.943376    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" (UID: "8a1eac2f-d61f-40e1-85a4-3bf92eb14b97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:14:34.034261 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.034151    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.034261 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.034196    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6hqw\" (UniqueName: \"kubernetes.io/projected/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-kube-api-access-c6hqw\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.034261 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.034211    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.034261 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.034220    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:34.545824 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.545787    2584 generic.go:356] "Generic (PLEG): container finished" podID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" containerID="70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645" exitCode=0
Sep 15 14:14:34.546222 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.545846    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"
Sep 15 14:14:34.546222 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.545869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" event={"ID":"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97","Type":"ContainerDied","Data":"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"}
Sep 15 14:14:34.546222 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.545922    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8" event={"ID":"8a1eac2f-d61f-40e1-85a4-3bf92eb14b97","Type":"ContainerDied","Data":"9b80760b47f625df1cb5c6194f6d61e06ef0f5fef8d9f3f174ff84764d9a80e6"}
Sep 15 14:14:34.546222 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.545944    2584 scope.go:117] "RemoveContainer" containerID="70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"
Sep 15 14:14:34.555543 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.555526    2584 scope.go:117] "RemoveContainer" containerID="70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"
Sep 15 14:14:34.555906 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:14:34.555886    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645\": container with ID starting with 70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645 not found: ID does not exist" containerID="70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"
Sep 15 14:14:34.555964 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.555916    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645"} err="failed to get container status \"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645\": rpc error: code = NotFound desc = could not find container \"70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645\": container with ID starting with 70524bc53e98ed5af19c6aecb5b975c64ddf73e8154bda39a9e568b56bb3a645 not found: ID does not exist"
Sep 15 14:14:34.571179 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.571142    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:14:34.577318 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:34.577288    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-746f54-6bbcd86f64-jtcj8"]
Sep 15 14:14:35.263743 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:35.263713    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" path="/var/lib/kubelet/pods/8a1eac2f-d61f-40e1-85a4-3bf92eb14b97/volumes"
Sep 15 14:14:56.628061 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.628019    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:14:56.628556 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.628230    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" podUID="27dfeef9-faca-4ff2-9e61-77b48121cb03" containerName="maas-api" containerID="cri-o://dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846" gracePeriod=30
Sep 15 14:14:56.906140 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.906109    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:14:56.964681 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.964629    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs\") pod \"27dfeef9-faca-4ff2-9e61-77b48121cb03\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") "
Sep 15 14:14:56.964872 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.964746    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtlsv\" (UniqueName: \"kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv\") pod \"27dfeef9-faca-4ff2-9e61-77b48121cb03\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") "
Sep 15 14:14:56.964872 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.964793    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls\") pod \"27dfeef9-faca-4ff2-9e61-77b48121cb03\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") "
Sep 15 14:14:56.964872 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.964827    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca\") pod \"27dfeef9-faca-4ff2-9e61-77b48121cb03\" (UID: \"27dfeef9-faca-4ff2-9e61-77b48121cb03\") "
Sep 15 14:14:56.965303 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.965271    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27dfeef9-faca-4ff2-9e61-77b48121cb03" (UID: "27dfeef9-faca-4ff2-9e61-77b48121cb03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:14:56.967424 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.967362    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv" (OuterVolumeSpecName: "kube-api-access-qtlsv") pod "27dfeef9-faca-4ff2-9e61-77b48121cb03" (UID: "27dfeef9-faca-4ff2-9e61-77b48121cb03"). InnerVolumeSpecName "kube-api-access-qtlsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:14:56.967551 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.967462    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27dfeef9-faca-4ff2-9e61-77b48121cb03" (UID: "27dfeef9-faca-4ff2-9e61-77b48121cb03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:14:56.967724 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:56.967691    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "27dfeef9-faca-4ff2-9e61-77b48121cb03" (UID: "27dfeef9-faca-4ff2-9e61-77b48121cb03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:14:57.065907 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.065869    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.065907 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.065903    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtlsv\" (UniqueName: \"kubernetes.io/projected/27dfeef9-faca-4ff2-9e61-77b48121cb03-kube-api-access-qtlsv\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.065907 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.065913    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27dfeef9-faca-4ff2-9e61-77b48121cb03-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.066169 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.065922    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27dfeef9-faca-4ff2-9e61-77b48121cb03-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:14:57.680615 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.680578    2584 generic.go:356] "Generic (PLEG): container finished" podID="27dfeef9-faca-4ff2-9e61-77b48121cb03" containerID="dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846" exitCode=0
Sep 15 14:14:57.681053 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.680636    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"
Sep 15 14:14:57.681053 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.680651    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" event={"ID":"27dfeef9-faca-4ff2-9e61-77b48121cb03","Type":"ContainerDied","Data":"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"}
Sep 15 14:14:57.681053 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.680728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4" event={"ID":"27dfeef9-faca-4ff2-9e61-77b48121cb03","Type":"ContainerDied","Data":"65c1ba14a6d56822f01c9b80c122dc885c0f97f934abcdd460be5bcef7024df8"}
Sep 15 14:14:57.681053 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.680753    2584 scope.go:117] "RemoveContainer" containerID="dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"
Sep 15 14:14:57.689746 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.689719    2584 scope.go:117] "RemoveContainer" containerID="dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"
Sep 15 14:14:57.690033 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:14:57.690012    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846\": container with ID starting with dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846 not found: ID does not exist" containerID="dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"
Sep 15 14:14:57.690091 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.690041    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846"} err="failed to get container status \"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846\": rpc error: code = NotFound desc = could not find container \"dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846\": container with ID starting with dee2380ef028c45aca99920118d72e1b001f7e4c91f891a0b2dd8c477c9b1846 not found: ID does not exist"
Sep 15 14:14:57.707081 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.707048    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:14:57.711810 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:57.711782    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e50cdb-784dfccf44-jc9z4"]
Sep 15 14:14:59.264106 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:14:59.264072    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27dfeef9-faca-4ff2-9e61-77b48121cb03" path="/var/lib/kubelet/pods/27dfeef9-faca-4ff2-9e61-77b48121cb03/volumes"
Sep 15 14:15:00.277305 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277269    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"]
Sep 15 14:15:00.277821 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277806    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27dfeef9-faca-4ff2-9e61-77b48121cb03" containerName="maas-api"
Sep 15 14:15:00.277885 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277823    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27dfeef9-faca-4ff2-9e61-77b48121cb03" containerName="maas-api"
Sep 15 14:15:00.277885 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277836    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" containerName="maas-api"
Sep 15 14:15:00.277885 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277842    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" containerName="maas-api"
Sep 15 14:15:00.278044 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277927    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1eac2f-d61f-40e1-85a4-3bf92eb14b97" containerName="maas-api"
Sep 15 14:15:00.278044 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.277937    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="27dfeef9-faca-4ff2-9e61-77b48121cb03" containerName="maas-api"
Sep 15 14:15:00.283798 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.283765    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:00.286458 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.286433    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qzmkv\""
Sep 15 14:15:00.293883 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.293857    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"]
Sep 15 14:15:00.398941 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.398888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l\") pod \"maas-api-key-cleanup-29824695-rqzv2\" (UID: \"dab37ecc-8da4-44b0-8dd6-ec129b8345b1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:00.499654 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.499611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l\") pod \"maas-api-key-cleanup-29824695-rqzv2\" (UID: \"dab37ecc-8da4-44b0-8dd6-ec129b8345b1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:00.509185 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.509159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l\") pod \"maas-api-key-cleanup-29824695-rqzv2\" (UID: \"dab37ecc-8da4-44b0-8dd6-ec129b8345b1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:00.598399 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.598309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:00.872809 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:00.872784    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"]
Sep 15 14:15:00.875171 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:15:00.875142    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab37ecc_8da4_44b0_8dd6_ec129b8345b1.slice/crio-c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771 WatchSource:0}: Error finding container c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771: Status 404 returned error can't find the container with id c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771
Sep 15 14:15:01.706316 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:01.706280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2" event={"ID":"dab37ecc-8da4-44b0-8dd6-ec129b8345b1","Type":"ContainerStarted","Data":"c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771"}
Sep 15 14:15:03.721165 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:03.721131    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2" event={"ID":"dab37ecc-8da4-44b0-8dd6-ec129b8345b1","Type":"ContainerStarted","Data":"7618bc486408dcf08ea610fd1bc529cc76525d4d1edad8740a425d2b3e284ce7"}
Sep 15 14:15:03.738525 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:03.738469    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2" podStartSLOduration=1.266105369 podStartE2EDuration="3.738451438s" totalImagesPullingTime="2.472346069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:15:03.736152113 +0000 UTC m=+2178.985813432" watchObservedRunningTime="2026-09-15 14:15:03.738451438 +0000 UTC m=+2178.988112771"
Sep 15 14:15:04.729072 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:04.729036    2584 generic.go:356] "Generic (PLEG): container finished" podID="dab37ecc-8da4-44b0-8dd6-ec129b8345b1" containerID="7618bc486408dcf08ea610fd1bc529cc76525d4d1edad8740a425d2b3e284ce7" exitCode=0
Sep 15 14:15:04.729471 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:04.729126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2" event={"ID":"dab37ecc-8da4-44b0-8dd6-ec129b8345b1","Type":"ContainerDied","Data":"7618bc486408dcf08ea610fd1bc529cc76525d4d1edad8740a425d2b3e284ce7"}
Sep 15 14:15:05.885910 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:05.885877    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:05.955812 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:05.955775    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l\") pod \"dab37ecc-8da4-44b0-8dd6-ec129b8345b1\" (UID: \"dab37ecc-8da4-44b0-8dd6-ec129b8345b1\") "
Sep 15 14:15:05.957948 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:05.957920    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l" (OuterVolumeSpecName: "kube-api-access-r979l") pod "dab37ecc-8da4-44b0-8dd6-ec129b8345b1" (UID: "dab37ecc-8da4-44b0-8dd6-ec129b8345b1"). InnerVolumeSpecName "kube-api-access-r979l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:06.057528 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:06.057439    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/dab37ecc-8da4-44b0-8dd6-ec129b8345b1-kube-api-access-r979l\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:06.742383 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:06.742352    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2"
Sep 15 14:15:06.742383 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:06.742373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824695-rqzv2" event={"ID":"dab37ecc-8da4-44b0-8dd6-ec129b8345b1","Type":"ContainerDied","Data":"c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771"}
Sep 15 14:15:06.742563 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:06.742421    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c158674f74868982b2d98ab857e658cab6cbbe4cca7b0d3d864535ba9054b771"
Sep 15 14:15:15.336152 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.336113    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:15:15.336708 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.336353    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" podUID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" containerName="maas-api" containerID="cri-o://71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43" gracePeriod=30
Sep 15 14:15:15.608234 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.608208    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:15:15.753810 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.753755    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") pod \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") "
Sep 15 14:15:15.754018 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.753836    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca\") pod \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") "
Sep 15 14:15:15.754018 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.753956    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs\") pod \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") "
Sep 15 14:15:15.754018 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.753983    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwjnr\" (UniqueName: \"kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr\") pod \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\" (UID: \"b288b1ee-1e2d-424d-ba41-680d903ec8d9\") "
Sep 15 14:15:15.754700 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.754642    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b288b1ee-1e2d-424d-ba41-680d903ec8d9" (UID: "b288b1ee-1e2d-424d-ba41-680d903ec8d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:15.756310 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.756281    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b288b1ee-1e2d-424d-ba41-680d903ec8d9" (UID: "b288b1ee-1e2d-424d-ba41-680d903ec8d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:15:15.756549 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.756518    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b288b1ee-1e2d-424d-ba41-680d903ec8d9" (UID: "b288b1ee-1e2d-424d-ba41-680d903ec8d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:15:15.756643 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.756602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr" (OuterVolumeSpecName: "kube-api-access-vwjnr") pod "b288b1ee-1e2d-424d-ba41-680d903ec8d9" (UID: "b288b1ee-1e2d-424d-ba41-680d903ec8d9"). InnerVolumeSpecName "kube-api-access-vwjnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:15.801025 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.800989    2584 generic.go:356] "Generic (PLEG): container finished" podID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" containerID="71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43" exitCode=0
Sep 15 14:15:15.801219 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.801033    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" event={"ID":"b288b1ee-1e2d-424d-ba41-680d903ec8d9","Type":"ContainerDied","Data":"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"}
Sep 15 14:15:15.801219 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.801043    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"
Sep 15 14:15:15.801219 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.801076    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg" event={"ID":"b288b1ee-1e2d-424d-ba41-680d903ec8d9","Type":"ContainerDied","Data":"5c8ddccee5b009af92b236f68c0b6ff86c9998c2aec5e489a14566eb5c396daf"}
Sep 15 14:15:15.801219 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.801101    2584 scope.go:117] "RemoveContainer" containerID="71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"
Sep 15 14:15:15.811992 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.811970    2584 scope.go:117] "RemoveContainer" containerID="71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"
Sep 15 14:15:15.812349 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:15:15.812326    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43\": container with ID starting with 71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43 not found: ID does not exist" containerID="71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"
Sep 15 14:15:15.812416 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.812362    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43"} err="failed to get container status \"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43\": rpc error: code = NotFound desc = could not find container \"71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43\": container with ID starting with 71506c286c6c1d076d812028090186d457ba114f89d7c38251b1e59137b60d43 not found: ID does not exist"
Sep 15 14:15:15.827323 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.827282    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:15:15.843270 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.843186    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-583e9a-7b458c7fbb-57xmg"]
Sep 15 14:15:15.855808 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.855772    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b288b1ee-1e2d-424d-ba41-680d903ec8d9-openshift-service-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.855808 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.855801    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.855808 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.855811    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwjnr\" (UniqueName: \"kubernetes.io/projected/b288b1ee-1e2d-424d-ba41-680d903ec8d9-kube-api-access-vwjnr\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:15.856030 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:15.855821    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b288b1ee-1e2d-424d-ba41-680d903ec8d9-maas-api-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:17.264979 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:17.264948    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" path="/var/lib/kubelet/pods/b288b1ee-1e2d-424d-ba41-680d903ec8d9/volumes"
Sep 15 14:15:33.598226 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.598189    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:15:33.599081 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.599027    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" podUID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" containerName="payload-processing" containerID="cri-o://37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b" gracePeriod=30
Sep 15 14:15:33.602898 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.602869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:15:33.603152 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.603107    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" podUID="77764c20-3269-45cb-8842-4451929fe8a1" containerName="payload-pre-processing" containerID="cri-o://8e8ea84abbb4b4e866cb4613e11d5954bbc21f3e1101e48cdee0f8d95483b6b6" gracePeriod=30
Sep 15 14:15:33.901685 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.901635    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:15:33.903768 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.903743    2584 generic.go:356] "Generic (PLEG): container finished" podID="77764c20-3269-45cb-8842-4451929fe8a1" containerID="8e8ea84abbb4b4e866cb4613e11d5954bbc21f3e1101e48cdee0f8d95483b6b6" exitCode=0
Sep 15 14:15:33.903892 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.903815    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" event={"ID":"77764c20-3269-45cb-8842-4451929fe8a1","Type":"ContainerDied","Data":"8e8ea84abbb4b4e866cb4613e11d5954bbc21f3e1101e48cdee0f8d95483b6b6"}
Sep 15 14:15:33.903892 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.903867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j" event={"ID":"77764c20-3269-45cb-8842-4451929fe8a1","Type":"ContainerDied","Data":"672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530"}
Sep 15 14:15:33.903892 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.903887    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="672a162b75bfeabbf05ac5ac3ec896b5aea45f5cb2973f32366317bfc3191530"
Sep 15 14:15:33.904783 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.904762    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:15:33.905374 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.905352    2584 generic.go:356] "Generic (PLEG): container finished" podID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" containerID="37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b" exitCode=0
Sep 15 14:15:33.905458 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.905385    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"
Sep 15 14:15:33.905497 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.905386    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" event={"ID":"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba","Type":"ContainerDied","Data":"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"}
Sep 15 14:15:33.905529 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.905500    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl" event={"ID":"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba","Type":"ContainerDied","Data":"702793579a01d37998288b1714c26d3d73aadda563c70d3869926653b377704a"}
Sep 15 14:15:33.905529 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.905524    2584 scope.go:117] "RemoveContainer" containerID="37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"
Sep 15 14:15:33.915005 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.914982    2584 scope.go:117] "RemoveContainer" containerID="37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"
Sep 15 14:15:33.915367 ip-10-0-134-169 kubenswrapper[2584]: E0915 14:15:33.915343    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b\": container with ID starting with 37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b not found: ID does not exist" containerID="37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"
Sep 15 14:15:33.915470 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.915376    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b"} err="failed to get container status \"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b\": rpc error: code = NotFound desc = could not find container \"37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b\": container with ID starting with 37952d26ec1f74c3cd2c18242e96460f52426cd0c7dfac025c23a1e19f3c7a5b not found: ID does not exist"
Sep 15 14:15:33.937375 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.937344    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rncvz\" (UniqueName: \"kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz\") pod \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") "
Sep 15 14:15:33.937575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.937404    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume\") pod \"77764c20-3269-45cb-8842-4451929fe8a1\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") "
Sep 15 14:15:33.937575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.937491    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzfh9\" (UniqueName: \"kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9\") pod \"77764c20-3269-45cb-8842-4451929fe8a1\" (UID: \"77764c20-3269-45cb-8842-4451929fe8a1\") "
Sep 15 14:15:33.937575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.937552    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume\") pod \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\" (UID: \"40d6844e-1a0c-4f86-a9dd-7332d9f2aaba\") "
Sep 15 14:15:33.938494 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.938457    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" (UID: "40d6844e-1a0c-4f86-a9dd-7332d9f2aaba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:33.939209 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.939182    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-plugins-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:33.941027 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.939879    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77764c20-3269-45cb-8842-4451929fe8a1" (UID: "77764c20-3269-45cb-8842-4451929fe8a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:15:33.941027 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.940982    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9" (OuterVolumeSpecName: "kube-api-access-xzfh9") pod "77764c20-3269-45cb-8842-4451929fe8a1" (UID: "77764c20-3269-45cb-8842-4451929fe8a1"). InnerVolumeSpecName "kube-api-access-xzfh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:33.942801 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:33.942138    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz" (OuterVolumeSpecName: "kube-api-access-rncvz") pod "40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" (UID: "40d6844e-1a0c-4f86-a9dd-7332d9f2aaba"). InnerVolumeSpecName "kube-api-access-rncvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:15:34.040571 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.040520    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rncvz\" (UniqueName: \"kubernetes.io/projected/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba-kube-api-access-rncvz\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:34.040571 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.040562    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77764c20-3269-45cb-8842-4451929fe8a1-plugins-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:34.040571 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.040575    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzfh9\" (UniqueName: \"kubernetes.io/projected/77764c20-3269-45cb-8842-4451929fe8a1-kube-api-access-xzfh9\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:15:34.229129 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.229087    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:15:34.231480 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.231453    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl"]
Sep 15 14:15:34.911539 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.911514    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"
Sep 15 14:15:34.936086 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.936052    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:15:34.939854 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:34.939823    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j"]
Sep 15 14:15:35.264031 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:35.263950    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" path="/var/lib/kubelet/pods/40d6844e-1a0c-4f86-a9dd-7332d9f2aaba/volumes"
Sep 15 14:15:35.264347 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:35.264333    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77764c20-3269-45cb-8842-4451929fe8a1" path="/var/lib/kubelet/pods/77764c20-3269-45cb-8842-4451929fe8a1/volumes"
Sep 15 14:15:45.508144 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:15:45.508110    2584 scope.go:117] "RemoveContainer" containerID="8e8ea84abbb4b4e866cb4613e11d5954bbc21f3e1101e48cdee0f8d95483b6b6"
Sep 15 14:25:40.972412 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:40.972378    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:25:40.973233 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:40.972643    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" podUID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" containerName="payload-pre-processing" containerID="cri-o://47a0bccbe8a8b93713717e81f9423220cffd3889682231c999793be7cbf1a35e" gracePeriod=30
Sep 15 14:25:41.181199 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.181163    2584 generic.go:356] "Generic (PLEG): container finished" podID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" containerID="47a0bccbe8a8b93713717e81f9423220cffd3889682231c999793be7cbf1a35e" exitCode=0
Sep 15 14:25:41.181357 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.181243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" event={"ID":"01cd9a0d-8429-4e7b-832b-a1a7580f31e2","Type":"ContainerDied","Data":"47a0bccbe8a8b93713717e81f9423220cffd3889682231c999793be7cbf1a35e"}
Sep 15 14:25:41.238484 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.238419    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:25:41.253300 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.253269    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx877\" (UniqueName: \"kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877\") pod \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") "
Sep 15 14:25:41.253491 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.253330    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume\") pod \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\" (UID: \"01cd9a0d-8429-4e7b-832b-a1a7580f31e2\") "
Sep 15 14:25:41.253884 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.253796    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01cd9a0d-8429-4e7b-832b-a1a7580f31e2" (UID: "01cd9a0d-8429-4e7b-832b-a1a7580f31e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 14:25:41.256443 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.256395    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877" (OuterVolumeSpecName: "kube-api-access-cx877") pod "01cd9a0d-8429-4e7b-832b-a1a7580f31e2" (UID: "01cd9a0d-8429-4e7b-832b-a1a7580f31e2"). InnerVolumeSpecName "kube-api-access-cx877". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:25:41.354475 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.354439    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx877\" (UniqueName: \"kubernetes.io/projected/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-kube-api-access-cx877\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:25:41.354475 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:41.354468    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cd9a0d-8429-4e7b-832b-a1a7580f31e2-plugins-config-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:25:42.188274 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:42.188247    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"
Sep 15 14:25:42.188683 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:42.188288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8" event={"ID":"01cd9a0d-8429-4e7b-832b-a1a7580f31e2","Type":"ContainerDied","Data":"fd85c806aace7d15475660fa68de302a7aeba58bed995286e834ac38c3373c5c"}
Sep 15 14:25:42.188683 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:42.188347    2584 scope.go:117] "RemoveContainer" containerID="47a0bccbe8a8b93713717e81f9423220cffd3889682231c999793be7cbf1a35e"
Sep 15 14:25:42.207388 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:42.207354    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:25:42.214571 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:42.214537    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8"]
Sep 15 14:25:43.263121 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:25:43.263088    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" path="/var/lib/kubelet/pods/01cd9a0d-8429-4e7b-832b-a1a7580f31e2/volumes"
Sep 15 14:27:40.665532 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.665491    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 14:27:40.666104 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.665715    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" podUID="6c073604-cfa0-478f-95ea-d99cf882e620" containerName="manager" containerID="cri-o://c053e5fb8aab558d87d6cf2157eea70ce281421243efacabe07bed0db7edc34f" gracePeriod=30
Sep 15 14:27:40.824947 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.824909    2584 generic.go:356] "Generic (PLEG): container finished" podID="6c073604-cfa0-478f-95ea-d99cf882e620" containerID="c053e5fb8aab558d87d6cf2157eea70ce281421243efacabe07bed0db7edc34f" exitCode=0
Sep 15 14:27:40.825109 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.824986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" event={"ID":"6c073604-cfa0-478f-95ea-d99cf882e620","Type":"ContainerDied","Data":"c053e5fb8aab558d87d6cf2157eea70ce281421243efacabe07bed0db7edc34f"}
Sep 15 14:27:40.923694 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.923611    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 14:27:40.925729 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.925706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w82vb\" (UniqueName: \"kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb\") pod \"6c073604-cfa0-478f-95ea-d99cf882e620\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") "
Sep 15 14:27:40.925794 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.925747    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert\") pod \"6c073604-cfa0-478f-95ea-d99cf882e620\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") "
Sep 15 14:27:40.925875 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.925857    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs\") pod \"6c073604-cfa0-478f-95ea-d99cf882e620\" (UID: \"6c073604-cfa0-478f-95ea-d99cf882e620\") "
Sep 15 14:27:40.927848 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.927812    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6c073604-cfa0-478f-95ea-d99cf882e620" (UID: "6c073604-cfa0-478f-95ea-d99cf882e620"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:27:40.927986 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.927962    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6c073604-cfa0-478f-95ea-d99cf882e620" (UID: "6c073604-cfa0-478f-95ea-d99cf882e620"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 14:27:40.928035 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:40.927982    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb" (OuterVolumeSpecName: "kube-api-access-w82vb") pod "6c073604-cfa0-478f-95ea-d99cf882e620" (UID: "6c073604-cfa0-478f-95ea-d99cf882e620"). InnerVolumeSpecName "kube-api-access-w82vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 14:27:41.026852 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.026813    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w82vb\" (UniqueName: \"kubernetes.io/projected/6c073604-cfa0-478f-95ea-d99cf882e620-kube-api-access-w82vb\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:27:41.026852 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.026843    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-webhook-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:27:41.026852 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.026852    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c073604-cfa0-478f-95ea-d99cf882e620-metrics-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\""
Sep 15 14:27:41.832065 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.832030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5745f64bd7-cmfrb" event={"ID":"6c073604-cfa0-478f-95ea-d99cf882e620","Type":"ContainerDied","Data":"124f9674089e5907fe163eeb98396559dc4d158f937dc27c207f4f6bac3e567b"}
Sep 15 14:27:41.832065 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.832052    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5745f64bd7-cmfrb"
Sep 15 14:27:41.832575 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.832099    2584 scope.go:117] "RemoveContainer" containerID="c053e5fb8aab558d87d6cf2157eea70ce281421243efacabe07bed0db7edc34f"
Sep 15 14:27:41.851949 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.851921    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 14:27:41.856158 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:41.856131    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5745f64bd7-cmfrb"]
Sep 15 14:27:43.263888 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:27:43.263858    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c073604-cfa0-478f-95ea-d99cf882e620" path="/var/lib/kubelet/pods/6c073604-cfa0-478f-95ea-d99cf882e620/volumes"
Sep 15 14:34:21.106715 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:21.106619    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-52xsk_f563eb5c-2ee2-4021-a095-518d2e65fa1d/copy-manifests/0.log"
Sep 15 14:34:21.125170 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:21.125132    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-52xsk_f563eb5c-2ee2-4021-a095-518d2e65fa1d/manager/0.log"
Sep 15 14:34:21.612966 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:21.612929    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-786fdf86ff-bzbx5_23dfa4e7-6c84-44a4-b487-bc897d95b335/maas-api/0.log"
Sep 15 14:34:21.729990 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:21.729958    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-4441a1-55dc88fc66-d9x6b_96667c44-0d7b-436e-bd02-fc39719169ca/maas-api/0.log"
Sep 15 14:34:21.965628 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:21.965593    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-worker-w0-1293e7-58b8f955b7-f8zrv_e216822e-9c44-48b6-963b-5e74ca73d24b/maas-api/0.log"
Sep 15 14:34:22.080261 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:22.080220    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-worker-w4-66261e-995576fb8-z4qmw_43309a39-0c4e-44f3-aeb1-c0bc15f38ca7/maas-api/0.log"
Sep 15 14:34:22.290955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:22.290872    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824695-rqzv2_dab37ecc-8da4-44b0-8dd6-ec129b8345b1/cleanup/0.log"
Sep 15 14:34:23.767513 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:23.767479    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6bc68_19130448-4cdf-43d6-8da4-1fbbbb6621e5/postgres/0.log"
Sep 15 14:34:25.625295 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:25.625255    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkt6n_90139334-c827-4d7c-996a-8910e3f9e684/discovery/0.log"
Sep 15 14:34:26.057807 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.057776    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nc9q7_1b6ff220-97c9-4141-a99a-9b3e76626694/payload-pre-processing/0.log"
Sep 15 14:34:26.169532 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.169496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb_66f95b44-31a7-4ba6-8902-3d2ec2a8f971/payload-pre-processing/0.log"
Sep 15 14:34:26.376948 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.376848    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq_d1afceb1-345d-443a-91b5-f2b8a61de5eb/payload-pre-processing/0.log"
Sep 15 14:34:26.485394 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.485366    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964_ad4be6af-502d-4b2e-bf1a-c2655630b175/payload-pre-processing/0.log"
Sep 15 14:34:26.600445 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.600410    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4d224_13359e71-01fe-4d1c-97df-4f20f909f80a/payload-processing/0.log"
Sep 15 14:34:26.812134 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.812090    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8_f7e80c74-eb20-465b-a443-a9d8e9fa45b3/payload-processing/0.log"
Sep 15 14:34:26.923751 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:26.923706    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk_cb15e7e7-1b78-4acf-bcf9-7ee815388d68/payload-processing/0.log"
Sep 15 14:34:27.033834 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:27.033788    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7_a7ed4b8e-acee-4313-b138-18a8cb3e9f10/payload-processing/0.log"
Sep 15 14:34:27.466227 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:27.466195    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hfr7h_6fba2563-56cc-459d-bd72-06a7d51c8176/main/0.log"
Sep 15 14:34:36.380268 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:36.380234    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-44z2n_63292c14-fa9c-41ff-96ca-2347852d9c34/global-pull-secret-syncer/0.log"
Sep 15 14:34:36.562700 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:36.562651    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqp9v_690bfaee-978d-425a-8e1d-4842bcefba0c/konnectivity-agent/0.log"
Sep 15 14:34:36.608611 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:36.608567    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-169.ec2.internal_2f20ece36e2cb445e1a70432e2a4cfba/haproxy/0.log"
Sep 15 14:34:43.049529 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.049501    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/alertmanager/0.log"
Sep 15 14:34:43.069055 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.069032    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/config-reloader/0.log"
Sep 15 14:34:43.089709 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.089654    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/kube-rbac-proxy-web/0.log"
Sep 15 14:34:43.110050 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.110016    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/kube-rbac-proxy/0.log"
Sep 15 14:34:43.129400 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.129372    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/kube-rbac-proxy-metric/0.log"
Sep 15 14:34:43.149481 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.149449    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/prom-label-proxy/0.log"
Sep 15 14:34:43.170939 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.170910    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2fcc9702-b8b8-45cf-8b8a-ec69a1711e14/init-config-reloader/0.log"
Sep 15 14:34:43.241927 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.241894    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5zljj_a24322c1-3065-4507-8ee1-7088d0e8f887/kube-state-metrics/0.log"
Sep 15 14:34:43.256374 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.256348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5zljj_a24322c1-3065-4507-8ee1-7088d0e8f887/kube-rbac-proxy-main/0.log"
Sep 15 14:34:43.275556 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.275527    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5zljj_a24322c1-3065-4507-8ee1-7088d0e8f887/kube-rbac-proxy-self/0.log"
Sep 15 14:34:43.303073 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.302990    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fb557ff7b-wh79h_34cf86ae-8ff2-4648-a277-535c017af72b/metrics-server/0.log"
Sep 15 14:34:43.326189 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.326143    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-zbz8k_5f5d01f0-cc4f-48e3-b71d-b68c04b336c7/monitoring-plugin/0.log"
Sep 15 14:34:43.435774 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.435739    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc27n_ea55a7f8-1f24-457f-a917-8fc5ff151094/node-exporter/0.log"
Sep 15 14:34:43.454679 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.454646    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc27n_ea55a7f8-1f24-457f-a917-8fc5ff151094/kube-rbac-proxy/0.log"
Sep 15 14:34:43.471251 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.471225    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc27n_ea55a7f8-1f24-457f-a917-8fc5ff151094/init-textfile/0.log"
Sep 15 14:34:43.613240 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.613163    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nckf8_9a7e1f55-9589-45ee-bfe8-8791e26ac7b0/kube-rbac-proxy-main/0.log"
Sep 15 14:34:43.631586 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.631561    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nckf8_9a7e1f55-9589-45ee-bfe8-8791e26ac7b0/kube-rbac-proxy-self/0.log"
Sep 15 14:34:43.649679 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.649636    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-nckf8_9a7e1f55-9589-45ee-bfe8-8791e26ac7b0/openshift-state-metrics/0.log"
Sep 15 14:34:43.690372 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.690339    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/prometheus/0.log"
Sep 15 14:34:43.709231 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.709200    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/config-reloader/0.log"
Sep 15 14:34:43.731598 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.731571    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/thanos-sidecar/0.log"
Sep 15 14:34:43.751654 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.751625    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/kube-rbac-proxy-web/0.log"
Sep 15 14:34:43.770693 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.770641    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/kube-rbac-proxy/0.log"
Sep 15 14:34:43.795382 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.795358    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/kube-rbac-proxy-thanos/0.log"
Sep 15 14:34:43.823718 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.823684    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c06be11-81a6-4b52-ae2c-e8ed9c2c7148/init-config-reloader/0.log"
Sep 15 14:34:43.861373 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.861334    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9z4dj_d5c020e4-89b9-4506-a2e4-5898e889fbb6/prometheus-operator/0.log"
Sep 15 14:34:43.880801 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:43.880724    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9z4dj_d5c020e4-89b9-4506-a2e4-5898e889fbb6/kube-rbac-proxy/0.log"
Sep 15 14:34:44.046756 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.046725    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/thanos-query/0.log"
Sep 15 14:34:44.066897 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.066868    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/kube-rbac-proxy-web/0.log"
Sep 15 14:34:44.086792 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.086770    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/kube-rbac-proxy/0.log"
Sep 15 14:34:44.108910 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.108888    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/prom-label-proxy/0.log"
Sep 15 14:34:44.129881 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.129849    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/kube-rbac-proxy-rules/0.log"
Sep 15 14:34:44.163307 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:44.163284    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbbb464fb-n4ld5_145c74f9-8550-45e4-bfa3-e4a7f8812246/kube-rbac-proxy-metrics/0.log"
Sep 15 14:34:46.835296 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835255    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"]
Sep 15 14:34:46.835866 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835849    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" containerName="payload-processing"
Sep 15 14:34:46.835866 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835867    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" containerName="payload-processing"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835875    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab37ecc-8da4-44b0-8dd6-ec129b8345b1" containerName="cleanup"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835881    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab37ecc-8da4-44b0-8dd6-ec129b8345b1" containerName="cleanup"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835896    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" containerName="payload-pre-processing"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835902    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" containerName="payload-pre-processing"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835923    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c073604-cfa0-478f-95ea-d99cf882e620" containerName="manager"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835929    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c073604-cfa0-478f-95ea-d99cf882e620" containerName="manager"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835936    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77764c20-3269-45cb-8842-4451929fe8a1" containerName="payload-pre-processing"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835942    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="77764c20-3269-45cb-8842-4451929fe8a1" containerName="payload-pre-processing"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835950    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" containerName="maas-api"
Sep 15 14:34:46.835955 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.835955    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" containerName="maas-api"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836017    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288b1ee-1e2d-424d-ba41-680d903ec8d9" containerName="maas-api"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836024    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="01cd9a0d-8429-4e7b-832b-a1a7580f31e2" containerName="payload-pre-processing"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836031    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab37ecc-8da4-44b0-8dd6-ec129b8345b1" containerName="cleanup"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836038    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c073604-cfa0-478f-95ea-d99cf882e620" containerName="manager"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836044    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="77764c20-3269-45cb-8842-4451929fe8a1" containerName="payload-pre-processing"
Sep 15 14:34:46.836256 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.836050    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d6844e-1a0c-4f86-a9dd-7332d9f2aaba" containerName="payload-processing"
Sep 15 14:34:46.839505 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.839483    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:46.841552 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.841518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnzfz\"/\"kube-root-ca.crt\""
Sep 15 14:34:46.842257 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.842234    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnzfz\"/\"openshift-service-ca.crt\""
Sep 15 14:34:46.842412 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.842271    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dnzfz\"/\"default-dockercfg-kqx7l\""
Sep 15 14:34:46.848822 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.848771    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"]
Sep 15 14:34:46.862756 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.862723    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-m7x54_4ea37fff-b707-43f1-b9f2-dd58647f1776/download-server/0.log"
Sep 15 14:34:46.938790 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.938751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tk9\" (UniqueName: \"kubernetes.io/projected/3a9cbb63-968d-40ab-a952-556d49c52de4-kube-api-access-l6tk9\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:46.938985 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.938820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-sys\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:46.938985 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.938839    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-lib-modules\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:46.938985 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.938865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-podres\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:46.938985 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:46.938950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-proc\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040127 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-sys\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040127 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-lib-modules\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-podres\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040215    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-proc\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tk9\" (UniqueName: \"kubernetes.io/projected/3a9cbb63-968d-40ab-a952-556d49c52de4-kube-api-access-l6tk9\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-proc\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040312    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-podres\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-sys\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.040384 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.040329    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9cbb63-968d-40ab-a952-556d49c52de4-lib-modules\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.047904 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.047879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tk9\" (UniqueName: \"kubernetes.io/projected/3a9cbb63-968d-40ab-a952-556d49c52de4-kube-api-access-l6tk9\") pod \"perf-node-gather-daemonset-2sbrn\" (UID: \"3a9cbb63-968d-40ab-a952-556d49c52de4\") " pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.153211 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.153173    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:47.427851 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:47.427822    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"]
Sep 15 14:34:47.430031 ip-10-0-134-169 kubenswrapper[2584]: W0915 14:34:47.430003    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a9cbb63_968d_40ab_a952_556d49c52de4.slice/crio-514dcda928a0c3cb56840270988de5df0e525b54a1b4c870658f3eb7f3b1f388 WatchSource:0}: Error finding container 514dcda928a0c3cb56840270988de5df0e525b54a1b4c870658f3eb7f3b1f388: Status 404 returned error can't find the container with id 514dcda928a0c3cb56840270988de5df0e525b54a1b4c870658f3eb7f3b1f388
Sep 15 14:34:48.079253 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.079215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn" event={"ID":"3a9cbb63-968d-40ab-a952-556d49c52de4","Type":"ContainerStarted","Data":"d6da6a62a5a0d069b4ed48bcb93701975599e4dbf7c9e42b19a570eed8e76194"}
Sep 15 14:34:48.079685 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.079268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn" event={"ID":"3a9cbb63-968d-40ab-a952-556d49c52de4","Type":"ContainerStarted","Data":"514dcda928a0c3cb56840270988de5df0e525b54a1b4c870658f3eb7f3b1f388"}
Sep 15 14:34:48.079685 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.079376    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:48.093898 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.093849    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn" podStartSLOduration=2.093833014 podStartE2EDuration="2.093833014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 14:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 14:34:48.093148249 +0000 UTC m=+3363.342810064" watchObservedRunningTime="2026-09-15 14:34:48.093833014 +0000 UTC m=+3363.343494308"
Sep 15 14:34:48.734237 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.734203    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfxf5_0cd47974-6403-4c17-b1fa-2e14af7e1d16/dns/0.log"
Sep 15 14:34:48.752888 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.752859    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfxf5_0cd47974-6403-4c17-b1fa-2e14af7e1d16/kube-rbac-proxy/0.log"
Sep 15 14:34:48.839096 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:48.839067    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6q7cq_30a14812-e5b3-44ca-838c-9cca83be1f8d/dns-node-resolver/0.log"
Sep 15 14:34:49.444434 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:49.444407    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zt9tn_6b682f9b-c411-41c1-96a0-84d00a22b000/node-ca/0.log"
Sep 15 14:34:50.992162 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:50.992129    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkt6n_90139334-c827-4d7c-996a-8910e3f9e684/discovery/0.log"
Sep 15 14:34:51.101798 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.101764    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nc9q7_1b6ff220-97c9-4141-a99a-9b3e76626694/payload-pre-processing/0.log"
Sep 15 14:34:51.124969 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.124937    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb_66f95b44-31a7-4ba6-8902-3d2ec2a8f971/payload-pre-processing/0.log"
Sep 15 14:34:51.174424 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.174394    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq_d1afceb1-345d-443a-91b5-f2b8a61de5eb/payload-pre-processing/0.log"
Sep 15 14:34:51.199619 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.199590    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964_ad4be6af-502d-4b2e-bf1a-c2655630b175/payload-pre-processing/0.log"
Sep 15 14:34:51.232765 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.232734    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4d224_13359e71-01fe-4d1c-97df-4f20f909f80a/payload-processing/0.log"
Sep 15 14:34:51.276947 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.276855    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8_f7e80c74-eb20-465b-a443-a9d8e9fa45b3/payload-processing/0.log"
Sep 15 14:34:51.302784 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.302757    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk_cb15e7e7-1b78-4acf-bcf9-7ee815388d68/payload-processing/0.log"
Sep 15 14:34:51.323294 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:51.323254    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7_a7ed4b8e-acee-4313-b138-18a8cb3e9f10/payload-processing/0.log"
Sep 15 14:34:52.270506 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:52.270475    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brvg5_7ae0c065-cd30-4ab1-98f6-4e0a7bdd41bd/serve-healthcheck-canary/0.log"
Sep 15 14:34:52.802290 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:52.802260    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gpdc4_aab5a1f9-daf6-431a-8e71-83be5dcd68e0/kube-rbac-proxy/0.log"
Sep 15 14:34:52.819544 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:52.819509    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gpdc4_aab5a1f9-daf6-431a-8e71-83be5dcd68e0/exporter/0.log"
Sep 15 14:34:52.837772 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:52.837743    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gpdc4_aab5a1f9-daf6-431a-8e71-83be5dcd68e0/extractor/0.log"
Sep 15 14:34:54.094397 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:54.094373    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dnzfz/perf-node-gather-daemonset-2sbrn"
Sep 15 14:34:55.580483 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:55.580451    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-52xsk_f563eb5c-2ee2-4021-a095-518d2e65fa1d/manager/0.log"
Sep 15 14:34:55.616354 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:55.616324    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c64c4b4d-52xsk_f563eb5c-2ee2-4021-a095-518d2e65fa1d/copy-manifests/0.log"
Sep 15 14:34:57.190004 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.189973    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6445fb96b-tbdck_91ccf213-4435-4145-9a7e-cfbd8065a7d5/manager/0.log"
Sep 15 14:34:57.440205 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.440120    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkt6n_90139334-c827-4d7c-996a-8910e3f9e684/discovery/0.log"
Sep 15 14:34:57.509770 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.509727    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nc9q7_1b6ff220-97c9-4141-a99a-9b3e76626694/payload-pre-processing/0.log"
Sep 15 14:34:57.524346 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.524315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb_66f95b44-31a7-4ba6-8902-3d2ec2a8f971/payload-pre-processing/0.log"
Sep 15 14:34:57.557054 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.557022    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq_d1afceb1-345d-443a-91b5-f2b8a61de5eb/payload-pre-processing/0.log"
Sep 15 14:34:57.570794 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.570762    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964_ad4be6af-502d-4b2e-bf1a-c2655630b175/payload-pre-processing/0.log"
Sep 15 14:34:57.595367 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.595332    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4d224_13359e71-01fe-4d1c-97df-4f20f909f80a/payload-processing/0.log"
Sep 15 14:34:57.619845 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.619821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8_f7e80c74-eb20-465b-a443-a9d8e9fa45b3/payload-processing/0.log"
Sep 15 14:34:57.634746 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.634711    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk_cb15e7e7-1b78-4acf-bcf9-7ee815388d68/payload-processing/0.log"
Sep 15 14:34:57.648521 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:57.648489    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7_a7ed4b8e-acee-4313-b138-18a8cb3e9f10/payload-processing/0.log"
Sep 15 14:34:59.853318 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:59.853281    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fkt6n_90139334-c827-4d7c-996a-8910e3f9e684/discovery/0.log"
Sep 15 14:34:59.939142 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:59.939112    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nc9q7_1b6ff220-97c9-4141-a99a-9b3e76626694/payload-pre-processing/0.log"
Sep 15 14:34:59.955837 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:59.955798    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb_66f95b44-31a7-4ba6-8902-3d2ec2a8f971/payload-pre-processing/0.log"
Sep 15 14:34:59.988345 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:34:59.988307    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq_d1afceb1-345d-443a-91b5-f2b8a61de5eb/payload-pre-processing/0.log"
Sep 15 14:35:00.001658 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:00.001628    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964_ad4be6af-502d-4b2e-bf1a-c2655630b175/payload-pre-processing/0.log"
Sep 15 14:35:00.026778 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:00.026750    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4d224_13359e71-01fe-4d1c-97df-4f20f909f80a/payload-processing/0.log"
Sep 15 14:35:00.054698 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:00.054647    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8_f7e80c74-eb20-465b-a443-a9d8e9fa45b3/payload-processing/0.log"
Sep 15 14:35:00.074482 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:00.074451    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk_cb15e7e7-1b78-4acf-bcf9-7ee815388d68/payload-processing/0.log"
Sep 15 14:35:00.088265 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:00.088229    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7_a7ed4b8e-acee-4313-b138-18a8cb3e9f10/payload-processing/0.log"
Sep 15 14:35:02.084797 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:02.084768    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vswhd_f450f250-0148-4040-a42d-e68a6dfab993/migrator/0.log"
Sep 15 14:35:02.101788 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:02.101758    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vswhd_f450f250-0148-4040-a42d-e68a6dfab993/graceful-termination/0.log"
Sep 15 14:35:03.759986 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.759958    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/kube-multus-additional-cni-plugins/0.log"
Sep 15 14:35:03.780772 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.780741    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/egress-router-binary-copy/0.log"
Sep 15 14:35:03.799789 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.799761    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/cni-plugins/0.log"
Sep 15 14:35:03.820160 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.820132    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/bond-cni-plugin/0.log"
Sep 15 14:35:03.839432 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.839402    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/routeoverride-cni/0.log"
Sep 15 14:35:03.858725 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.858699    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/whereabouts-cni-bincopy/0.log"
Sep 15 14:35:03.876836 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.876812    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x22n5_378ecd87-0224-4d80-88f7-b64aee047bb4/whereabouts-cni/0.log"
Sep 15 14:35:03.920630 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:03.920599    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kf5q9_7ce24c24-943a-4ce4-84ef-c1250007388e/kube-multus/0.log"
Sep 15 14:35:04.075585 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:04.075502    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jknc_36a140e3-e410-4d68-adc7-f92983bd75b8/network-metrics-daemon/0.log"
Sep 15 14:35:04.111442 ip-10-0-134-169 kubenswrapper[2584]: I0915 14:35:04.111407    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jknc_36a140e3-e410-4d68-adc7-f92983bd75b8/kube-rbac-proxy/0.log"