Sep 16 21:49:03.333402 ip-10-0-138-103 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 21:49:03.733798 ip-10-0-138-103 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:49:03.733798 ip-10-0-138-103 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 21:49:03.733798 ip-10-0-138-103 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:49:03.733798 ip-10-0-138-103 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 21:49:03.733798 ip-10-0-138-103 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:49:03.735609 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.735522    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 21:49:03.739978 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739955    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.739978 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739974    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.739978 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739978    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.739978 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739981    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.739978 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739984    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739987    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739991    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739993    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.739996    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740000    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740004    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740008    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740011    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740014    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740016    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740019    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740022    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740025    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740028    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740031    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740034    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740037    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740040    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740042    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.740210 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740045    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740049    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740053    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740056    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740059    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740061    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740064    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740067    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740070    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740074    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740076    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740079    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740082    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740084    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740088    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740092    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740094    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740113    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740116    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.740700 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740120    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740124    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740127    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740130    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740134    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740137    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740139    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740144    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740146    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740149    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740152    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740155    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740158    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740161    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740164    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740167    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740169    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740172    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740174    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740177    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.741204 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740180    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740183    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740185    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740188    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740191    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740194    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740196    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740199    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740202    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740205    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740208    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740210    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740213    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740216    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740219    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740221    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740224    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740227    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740232    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.741691 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740236    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740239    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740242    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740246    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740249    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740252    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740255    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740257    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740260    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740263    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740266    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740269    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740272    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740274    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740277    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740280    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.740282    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741007    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741014    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741018    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.742200 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741022    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741025    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741028    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741031    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741033    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741036    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741038    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741041    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741044    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741046    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741049    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741051    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741054    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741056    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741060    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741062    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741064    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741069    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741072    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741075    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.742720 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741078    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741080    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741083    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741086    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741088    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741091    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741093    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741110    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741115    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741119    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741122    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741125    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741128    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741132    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741134    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741137    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741140    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741143    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741145    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741148    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.743269 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741150    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741153    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741156    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741158    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741161    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741163    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741168    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741172    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741175    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741178    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741181    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741184    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741186    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741189    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741192    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741195    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741198    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741201    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741204    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.743758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741207    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741210    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741213    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741216    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741219    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741222    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741225    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741228    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741231    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741233    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741236    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741239    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741241    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741244    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741246    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741249    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741253    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741255    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741258    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.744239 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741262    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741265    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741269    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741272    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741275    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741277    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741280    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741283    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741285    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741288    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741291    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741294    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741296    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741299    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741301    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741304    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741306    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741309    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741701    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741706    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.744717 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741709    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741712    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741714    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741718    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741720    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741723    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741726    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741729    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741731    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741734    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741736    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741739    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741742    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741744    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741747    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741750    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741753    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741755    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741758    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741761    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.745231 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741764    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741766    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741769    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741772    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741775    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741777    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741780    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741783    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741785    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741788    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741791    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741793    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741795    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741798    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741800    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741803    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741805    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741808    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741811    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.745806 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741813    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741816    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741818    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741821    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741824    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741826    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741829    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741832    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741835    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741837    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741840    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741842    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741845    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741847    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741850    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741853    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741855    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741858    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741860    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741865    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.746292 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741868    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741870    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741873    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741875    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741878    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741880    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741883    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741886    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741888    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741890    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741893    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741896    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741899    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741903    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741908    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741912    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741915    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741917    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741920    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.746802 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741923    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741925    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741928    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741931    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741933    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741936    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741939    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741941    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741944    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741947    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741949    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741952    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741956    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741959    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741962    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741964    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741968    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741971    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.741974    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742049    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 21:49:03.747274 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742090    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742110    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742115    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742120    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742123    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742128    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742132    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742135    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742138    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742142    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742146    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742149    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742152    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742155    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742158    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742162    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742166    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742170    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742173    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742176    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742180    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742183    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742187    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 21:49:03.747764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742190    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742195    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742199    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742202    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742205    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742209    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742212    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742215    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742219    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742223    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742226    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742229    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742232    2561 flags.go:64] FLAG: --enable-server="true"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742235    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742239    2561 flags.go:64] FLAG: --event-burst="100"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742242    2561 flags.go:64] FLAG: --event-qps="50"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742245    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742248    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742251    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742255    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742258    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742261    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742264    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742267    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742270    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 21:49:03.748329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742274    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742277    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742279    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742282    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742287    2561 flags.go:64] FLAG: --feature-gates=""
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742291    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742294    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742297    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742301    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742304    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742307    2561 flags.go:64] FLAG: --help="false"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742310    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742313    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742316    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742319    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742323    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742326    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742329    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742332    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742335    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742338    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742340    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742343    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742346    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 16 21:49:03.749015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742349    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742352    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742355    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742358    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742361    2561 flags.go:64] FLAG: --lock-file=""
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742364    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742367    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742370    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742375    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742384    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742387    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742390    2561 flags.go:64] FLAG: --logging-format="text"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742394    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742398    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742400    2561 flags.go:64] FLAG: --manifest-url=""
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742403    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742408    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742411    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742415    2561 flags.go:64] FLAG: --max-pods="110"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742418    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742421    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742424    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742427    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742430    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742433    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 21:49:03.749617 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742436    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742443    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742446    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742449    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742452    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742455    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742460    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742463    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742466    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742469    2561 flags.go:64] FLAG: --port="10250"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742472    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742475    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e7fa02e6f8bb587a"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742478    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742481    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742484    2561 flags.go:64] FLAG: --register-node="true"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742487    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742490    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742495    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742497    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742502    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742505    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742509    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742512    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742515    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742518    2561 flags.go:64] FLAG: --runonce="false"
Sep 16 21:49:03.750247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742521    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742524    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742527    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742531    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742534    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742537    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742541    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742544    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742547    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742550    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742553    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742556    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742559    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742562    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742565    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742570    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742573    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742576    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742580    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742583    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742586    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742589    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742592    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742595    2561 flags.go:64] FLAG: --v="2"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742599    2561 flags.go:64] FLAG: --version="false"
Sep 16 21:49:03.750859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742606    2561 flags.go:64] FLAG: --vmodule=""
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742615    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.742619    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742744    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742748    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742751    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742754    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742757    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742760    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742763    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742766    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742770    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742773    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742776    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742779    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742781    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742784    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742787    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742789    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742792    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.751477 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742795    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742799    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742802    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742805    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742809    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742812    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742815    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742818    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742820    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742823    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742826    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742845    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742849    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742856    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742860    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742864    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742868    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742871    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742875    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.751962 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742878    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742880    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742883    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742886    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742889    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742891    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742894    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742897    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742899    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742902    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742905    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742908    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742911    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742913    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742916    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742918    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742921    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742924    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742927    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742929    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.752475 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742932    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742935    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742937    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742940    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742943    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742945    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742949    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742953    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742955    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742958    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742961    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742964    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742967    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742970    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742973    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742976    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742978    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742981    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742984    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.752963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742987    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742989    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742992    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742994    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.742997    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743000    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743003    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743005    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743008    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743011    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743013    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743016    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743019    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743021    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743024    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743027    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743029    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743032    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743035    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743039    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.753492 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743042    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743046    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743049    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.743052    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.743512    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.750304    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.750320    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.751412    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.751419    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751492    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751499    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751502    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751505    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751508    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.753982 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751512    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751515    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751518    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751520    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751523    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751526    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751529    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751532    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751534    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751537    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751540    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751542    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751545    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751547    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751550    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751553    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751555    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751558    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751560    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751564    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.754349 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751567    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751570    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751572    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751577    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751582    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751585    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751588    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751591    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751594    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751596    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751599    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751602    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751605    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751608    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751610    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751613    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751616    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751619    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751622    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.754839 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751624    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751628    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751632    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751635    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751638    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751640    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751643    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751646    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751649    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751652    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751654    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751657    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751660    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751664    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751667    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751670    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751673    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751676    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751678    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.755323 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751681    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751683    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751686    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751688    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751691    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751693    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751696    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751700    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751703    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751706    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751709    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751712    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751715    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751718    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751721    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751724    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751726    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751729    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751731    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.755825 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751734    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751736    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751739    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751742    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751745    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751747    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751750    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751753    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751756    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751760    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751762    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751765    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751767    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751770    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751773    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751775    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.756304 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751778    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.751783    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751925    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751930    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751933    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751936    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751939    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751941    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751944    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751947    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751950    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751952    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751955    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751958    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751960    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:49:03.756699 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751963    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751966    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751969    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751975    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751980    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751985    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751988    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751991    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751994    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.751996    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752005    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752009    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752012    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752015    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752017    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752020    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752023    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752025    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752028    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:49:03.757067 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752030    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752033    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752035    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752038    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752040    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752043    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752046    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752048    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752051    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752053    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752056    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752058    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752061    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752063    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752066    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752068    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752071    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752073    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752076    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752078    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:49:03.757543 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752081    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752084    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752086    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752089    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752110    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752116    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752119    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752126    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752131    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752135    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752139    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752142    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752146    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752149    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752151    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752154    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752158    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752162    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752164    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:49:03.758034 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752167    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752170    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752172    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752175    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752178    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752180    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752183    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752186    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752188    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752191    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752193    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752196    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752198    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752201    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752204    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752206    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752209    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752218    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752228    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752231    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:49:03.758509 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752234    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752236    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752239    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752241    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752244    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752247    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752249    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:03.752252    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.752257    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.752368    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.754435    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.755530    2561 server.go:1019] "Starting client certificate rotation"
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.755671    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 21:49:03.758997 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.755706    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 21:49:03.759331 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.757817    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 21:49:03.761085 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.761070    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 21:49:03.776514 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.776493    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 16 21:49:03.779376 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.779362    2561 log.go:25] "Validated CRI v1 image API"
Sep 16 21:49:03.780853 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.780838    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 21:49:03.784017 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.783994    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 86d3f821-bfc3-4a0a-9262-7dbcb8eeda7d:/dev/nvme0n1p4 f09a7208-3c18-4e5e-93af-3a87b500de21:/dev/nvme0n1p3]
Sep 16 21:49:03.784112 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.784017    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 21:49:03.785050 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.785034    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 21:49:03.789700 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.789587    2561 manager.go:216] Machine: {Timestamp:2026-09-16 21:49:03.788351273 +0000 UTC m=+0.340958968 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099806 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de8ce399c1d1d687eb13e2dbc714c SystemUUID:ec2de8ce-399c-1d1d-687e-b13e2dbc714c BootID:d68e895a-88ac-4245-ada5-04896c8260c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:da:98:cc:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:da:98:cc:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:9c:68:37:d7:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 21:49:03.789700 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.789693    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 21:49:03.789831 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.789770    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 21:49:03.792873 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.792847    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 21:49:03.793015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.792876    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 21:49:03.793700 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.793690    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 21:49:03.793735 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.793703    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 21:49:03.793735 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.793711    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 21:49:03.794453 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.794443    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 21:49:03.795226 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.795216    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 21:49:03.798523 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798512    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 21:49:03.798638 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798629    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 21:49:03.798681 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798660    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 21:49:03.798681 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798677    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 21:49:03.798770 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798690    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 21:49:03.798770 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798700    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 16 21:49:03.798770 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.798710    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 21:49:03.799159 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.799147    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 21:49:03.799199 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.799170    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 21:49:03.801394 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.801376    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 21:49:03.803728 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.803715    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 21:49:03.803777 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.803744    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 21:49:03.805278 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805266    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 21:49:03.805313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805282    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 21:49:03.805313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805288    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 21:49:03.805313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805293    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 21:49:03.805313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805302    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 21:49:03.805313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805307    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805322    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805327    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805333    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805338    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805347    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 21:49:03.805455 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.805352    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 21:49:03.806088 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.806075    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 21:49:03.806128 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.806086    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w29tg"
Sep 16 21:49:03.806128 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.806091    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 21:49:03.808929 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.808906    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 21:49:03.808929 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.808909    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 21:49:03.809094 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.809078    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 21:49:03.810109 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.810088    2561 server.go:1268] "Started kubelet"
Sep 16 21:49:03.810205 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.810182    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 21:49:03.810936 ip-10-0-138-103 systemd[1]: Started Kubernetes Kubelet.
Sep 16 21:49:03.814294 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.810696    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 21:49:03.814372 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.814325    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 21:49:03.815627 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.815610    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 21:49:03.816224 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.816198    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w29tg"
Sep 16 21:49:03.816959 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.816933    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 21:49:03.817591 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.817573    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 21:49:03.819755 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.818665    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-103.ec2.internal.18d5eb7bc77de302  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-103.ec2.internal,UID:ip-10-0-138-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-103.ec2.internal,},FirstTimestamp:2026-09-16 21:49:03.810061058 +0000 UTC m=+0.362668753,LastTimestamp:2026-09-16 21:49:03.810061058 +0000 UTC m=+0.362668753,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-103.ec2.internal,}"
Sep 16 21:49:03.822147 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.822125    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 21:49:03.822748 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.822731    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 21:49:03.822843 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.822802    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:03.823316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823289    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 21:49:03.823316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823295    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 21:49:03.823316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823317    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 21:49:03.823502 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823411    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 21:49:03.823502 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823418    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 21:49:03.823590 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823502    2561 factory.go:55] Registering systemd factory
Sep 16 21:49:03.823590 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823519    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 16 21:49:03.823739 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823723    2561 factory.go:153] Registering CRI-O factory
Sep 16 21:49:03.823786 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823743    2561 factory.go:223] Registration of the crio container factory successfully
Sep 16 21:49:03.823849 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823794    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 21:49:03.823849 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823815    2561 factory.go:103] Registering Raw factory
Sep 16 21:49:03.823849 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.823830    2561 manager.go:1196] Started watching for new ooms in manager
Sep 16 21:49:03.824265 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.824249    2561 manager.go:349] Starting recovery of all containers
Sep 16 21:49:03.834883 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.834867    2561 manager.go:354] Recovery completed
Sep 16 21:49:03.835452 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.835431    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:03.838302 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.838180    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-103.ec2.internal\" not found" node="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:03.840513 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.840501    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:03.842804 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.842776    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:03.842887 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.842828    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:03.842887 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.842843    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:03.843911 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.843896    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 21:49:03.844001 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.843976    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 21:49:03.844055 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.844014    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 21:49:03.844136 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.843951    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:03.845252 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845236    2561 policy_none.go:49] "None policy: Start"
Sep 16 21:49:03.845349 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845256    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 21:49:03.845349 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845272    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 21:49:03.845482 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845462    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:03.845564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845495    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:03.845564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.845505    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:03.846333 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.846321    2561 policy_none.go:47] "Start"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.873754    2561 manager.go:337] "Starting Device Plugin manager"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.873813    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.873827    2561 server.go:87] "Starting device plugin registration server"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.874165    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.874176    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.874293    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.874378    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.874388    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.874986    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 21:49:03.892499 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.875026    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:03.917519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.917487    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 21:49:03.918787 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.918764    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 21:49:03.918890 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.918820    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 21:49:03.918890 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.918846    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 21:49:03.918992 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.918957    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 21:49:03.921304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.921286    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:03.974518 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.974493    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:03.975555 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.975537    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:03.975635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.975569    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:03.975635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.975579    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:03.975635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.975609    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:03.983292 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:03.983271    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:03.983373 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.983299    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-103.ec2.internal\": node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:03.996945 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:03.996871    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.020037 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.020015    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"]
Sep 16 21:49:04.020123 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.020112    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:04.021745 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.021729    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:04.021832 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.021763    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:04.021832 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.021777    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:04.023159 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023144    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:04.023309 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.023360 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023324    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:04.023889 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023855    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:04.023889 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023878    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:04.023889 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023887    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:04.024022 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023924    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:04.024022 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023945    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:04.024022 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.023954    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:04.024739 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.024723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a262ce05dc84aec0c1c985f6191b9d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-103.ec2.internal\" (UID: \"a262ce05dc84aec0c1c985f6191b9d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.024791 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.024748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.024791 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.024773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.025265 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.025253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.025320 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.025277    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:49:04.025927 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.025906    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:49:04.025986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.025931    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:49:04.025986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.025941    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:49:04.050718 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.050698    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-103.ec2.internal\" not found" node="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.055189 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.055176    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-103.ec2.internal\" not found" node="ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.097424 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.097397    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.125854 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.125994 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a262ce05dc84aec0c1c985f6191b9d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-103.ec2.internal\" (UID: \"a262ce05dc84aec0c1c985f6191b9d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.125994 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.125994 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.125994 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a262ce05dc84aec0c1c985f6191b9d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-103.ec2.internal\" (UID: \"a262ce05dc84aec0c1c985f6191b9d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.125994 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.125956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df77dd7cf155c7328de087129b6535d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal\" (UID: \"df77dd7cf155c7328de087129b6535d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.197855 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.197811    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.298493 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.298408    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.353951 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.353920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.358070 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.358025    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:04.398888 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.398863    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.499881 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.499855    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.601589 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.601502    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.703030 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.702992    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.754825 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.754786    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 21:49:04.755367 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.754932    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 21:49:04.755367 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.754974    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 21:49:04.803548 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.803512    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.820894 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.820852    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 21:44:04 +0000 UTC" deadline="2028-06-10 09:02:57.071737668 +0000 UTC"
Sep 16 21:49:04.820894 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.820886    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15179h13m52.250855074s"
Sep 16 21:49:04.896725 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:04.896692    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda262ce05dc84aec0c1c985f6191b9d4d.slice/crio-07cd0328fac90b7ffbc225ec07f688c087601ec6c4e7cf4648fa42d269cab228 WatchSource:0}: Error finding container 07cd0328fac90b7ffbc225ec07f688c087601ec6c4e7cf4648fa42d269cab228: Status 404 returned error can't find the container with id 07cd0328fac90b7ffbc225ec07f688c087601ec6c4e7cf4648fa42d269cab228
Sep 16 21:49:04.897537 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:04.897512    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf77dd7cf155c7328de087129b6535d2.slice/crio-71c9098db51fe383a7516dfefaef4a5fdb7e6873e1cc11f177bf7e7758562518 WatchSource:0}: Error finding container 71c9098db51fe383a7516dfefaef4a5fdb7e6873e1cc11f177bf7e7758562518: Status 404 returned error can't find the container with id 71c9098db51fe383a7516dfefaef4a5fdb7e6873e1cc11f177bf7e7758562518
Sep 16 21:49:04.902590 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.902573    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:49:04.904210 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:04.904191    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:04.922604 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.922564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal" event={"ID":"a262ce05dc84aec0c1c985f6191b9d4d","Type":"ContainerStarted","Data":"07cd0328fac90b7ffbc225ec07f688c087601ec6c4e7cf4648fa42d269cab228"}
Sep 16 21:49:04.923710 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:04.923688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal" event={"ID":"df77dd7cf155c7328de087129b6535d2","Type":"ContainerStarted","Data":"71c9098db51fe383a7516dfefaef4a5fdb7e6873e1cc11f177bf7e7758562518"}
Sep 16 21:49:05.006852 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.006802    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-103.ec2.internal\" not found"
Sep 16 21:49:05.106730 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.106701    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:05.122905 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.122873    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:05.133616 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.133589    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 21:49:05.135722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.135705    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal"
Sep 16 21:49:05.143819 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.143770    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 21:49:05.165547 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.165522    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:05.800354 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.800318    2561 apiserver.go:52] "Watching apiserver"
Sep 16 21:49:05.808518 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.808486    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 21:49:05.810727 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.810689    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pbqpr","kube-system/konnectivity-agent-s8bzq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m","openshift-cluster-node-tuning-operator/tuned-sh74g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-tbsql","openshift-multus/multus-gr9rk","openshift-multus/network-metrics-daemon-cggth","kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal","openshift-dns/node-resolver-zl58p","openshift-image-registry/node-ca-92dsx","openshift-network-diagnostics/network-check-target-njx9t","openshift-network-operator/iptables-alerter-mmzzz","openshift-ovn-kubernetes/ovnkube-node-b4lcb"]
Sep 16 21:49:05.812538 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.812512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.813852 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.813829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.814635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.814538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 21:49:05.814635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.814578    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 21:49:05.814942 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.814917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.815025 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.814923    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.815272 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.815255    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kbhhr\""
Sep 16 21:49:05.815532 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.815514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.816195 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.816174    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 21:49:05.816283 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.816237    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.816407 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.816362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.816558 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.816540    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55zl7\""
Sep 16 21:49:05.816895 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.816876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.817515 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.817362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.817515 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.817385    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.817515 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.817432    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-85kdw\""
Sep 16 21:49:05.817745 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.817654    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 21:49:05.819835 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.818627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.819835 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.818679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.819835 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.818857    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.819835 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.819168    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ld75\""
Sep 16 21:49:05.820093 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.820073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.820531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.820374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.820927 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.820906    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 21:49:05.821451 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.821219    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kgd62\""
Sep 16 21:49:05.821451 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.821317    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 21:49:05.822422 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.822402    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 21:49:05.822606 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.822593    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 21:49:05.823116 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.822769    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 21:49:05.823197 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.823151    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8w97j\""
Sep 16 21:49:05.824840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.823510    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 21:49:05.824840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.823770    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.824840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.824609    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 21:49:05.825622 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.825601    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.825816 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.825789    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:05.827328 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.827272    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.829914 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.829883    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.830017 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.829913    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.830192 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.830174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:05.830192 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.830171    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 21:49:05.830333 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.830211    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4rzs\""
Sep 16 21:49:05.831499 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.831479    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:05.832299 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.832276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 21:49:05.832431 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.832413    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 21:49:05.832751 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.832729    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xsccz\""
Sep 16 21:49:05.833797 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.833770    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 21:49:05.833797 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.833785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:05.833956 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.833865    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:05.834071 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.834050    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dnm92\""
Sep 16 21:49:05.834201 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.834178    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 21:49:05.835564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.835541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:05.835666 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.835606    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:05.836748 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-bin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.836844 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-kubernetes\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.836844 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-bin\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.836844 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cnibin\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-device-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-systemd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-node-log\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.837009 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.836993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-conf\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-systemd\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ba7e57-837a-4474-ba76-e051a733d6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-daemon-config\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-etc-kubernetes\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-run\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-var-lib-kubelet\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-env-overrides\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/919659c2-ac64-438c-b817-68f1dbc37bca-iptables-alerter-script\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919659c2-ac64-438c-b817-68f1dbc37bca-host-slash\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-conf-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqtg\" (UniqueName: \"kubernetes.io/projected/3dacb361-b3f4-495a-ad72-22e0ae551849-kube-api-access-njqtg\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-etc-tuned\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-ovn\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.837553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-config\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837503    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-cnibin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837549    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-host\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-kubelet\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvvb4\" (UniqueName: \"kubernetes.io/projected/0d183d5e-2171-44ed-b326-0d80cc7897db-kube-api-access-vvvb4\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspd8\" (UniqueName: \"kubernetes.io/projected/63c32129-fedf-438d-babc-74629360c9fa-kube-api-access-mspd8\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-498dk\" (UniqueName: \"kubernetes.io/projected/be0588f2-97b8-458d-b985-ee55a71a069e-kube-api-access-498dk\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-multus\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-sys\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-log-socket\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-kubelet\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-hostroot\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-multus-certs\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.837978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-serviceca\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.838374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-script-lib\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg45k\" (UniqueName: \"kubernetes.io/projected/919659c2-ac64-438c-b817-68f1dbc37bca-kube-api-access-zg45k\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-netns\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-lib-modules\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv8kf\" (UniqueName: \"kubernetes.io/projected/57ba7e57-837a-4474-ba76-e051a733d6cf-kube-api-access-pv8kf\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-system-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-k8s-cni-cncf-io\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gplgp\" (UniqueName: \"kubernetes.io/projected/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-kube-api-access-gplgp\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-tmp\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-etc-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-socket-dir-parent\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.839279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-slash\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-netns\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-var-lib-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvcst\" (UniqueName: \"kubernetes.io/projected/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-kube-api-access-hvcst\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-modprobe-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.838959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysconfig\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.839014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-systemd-units\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.839042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-netd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.839066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-cni-binary-copy\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.840119 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.839095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-host\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.860208 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.860000    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq9dk"
Sep 16 21:49:05.867061 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.867038    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq9dk"
Sep 16 21:49:05.867938 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.867919    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:05.925118 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.925078    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 21:49:05.939364 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-log-socket\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.939364 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-kubelet\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-hostroot\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-multus-certs\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-serviceca\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0731d0a-d92c-4743-8649-109d1c45ae24-hosts-file\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-script-lib\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg45k\" (UniqueName: \"kubernetes.io/projected/919659c2-ac64-438c-b817-68f1dbc37bca-kube-api-access-zg45k\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-netns\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-konnectivity-ca\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.939588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-lib-modules\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv8kf\" (UniqueName: \"kubernetes.io/projected/57ba7e57-837a-4474-ba76-e051a733d6cf-kube-api-access-pv8kf\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-system-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-k8s-cni-cncf-io\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gplgp\" (UniqueName: \"kubernetes.io/projected/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-kube-api-access-gplgp\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqp8q\" (UniqueName: \"kubernetes.io/projected/c0731d0a-d92c-4743-8649-109d1c45ae24-kube-api-access-nqp8q\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-tmp\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-etc-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-socket-dir-parent\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-agent-certs\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-slash\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-netns\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-var-lib-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcst\" (UniqueName: \"kubernetes.io/projected/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-kube-api-access-hvcst\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.939999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-modprobe-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysconfig\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-systemd-units\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-netd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-cni-binary-copy\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-host\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-kubelet-config\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0731d0a-d92c-4743-8649-109d1c45ae24-tmp-dir\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-log-socket\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-bin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-kubelet\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-var-lib-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.940848 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-hostroot\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-netns\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940581    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-multus-certs\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-socket-dir-parent\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940703    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-system-cni-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-slash\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-host\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-netd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940925    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-modprobe-d\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940936    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.940966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysconfig\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-systemd-units\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-serviceca\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-bin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.941660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-system-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-cni-binary-copy\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-kubernetes\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-bin\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-k8s-cni-cncf-io\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cnibin\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-cni-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-lib-modules\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-kubernetes\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-device-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-systemd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-run-netns\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-device-dir\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.942566 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-node-log\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-cni-bin\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-conf\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-script-lib\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-systemd\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ba7e57-837a-4474-ba76-e051a733d6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.941837    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-daemon-config\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.941744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-sysctl-conf\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:05.942105    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:06.442069696 +0000 UTC m=+2.994677411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-etc-systemd\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-etc-openvswitch\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-systemd\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.943508 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942345    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-node-log\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-etc-kubernetes\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-cnibin\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-daemon-config\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-run\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-var-lib-kubelet\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-env-overrides\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-etc-kubernetes\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-var-lib-kubelet\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/919659c2-ac64-438c-b817-68f1dbc37bca-iptables-alerter-script\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-run\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919659c2-ac64-438c-b817-68f1dbc37bca-host-slash\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-conf-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqtg\" (UniqueName: \"kubernetes.io/projected/3dacb361-b3f4-495a-ad72-22e0ae551849-kube-api-access-njqtg\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919659c2-ac64-438c-b817-68f1dbc37bca-host-slash\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.944410 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-multus-conf-dir\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-etc-tuned\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-env-overrides\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-ovn\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.942990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-config\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-cnibin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-run-ovn\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-cnibin\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-host\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-kubelet\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-host\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63c32129-fedf-438d-babc-74629360c9fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvvb4\" (UniqueName: \"kubernetes.io/projected/0d183d5e-2171-44ed-b326-0d80cc7897db-kube-api-access-vvvb4\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/919659c2-ac64-438c-b817-68f1dbc37bca-iptables-alerter-script\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.945282 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943335    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ba7e57-837a-4474-ba76-e051a733d6cf-host-kubelet\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspd8\" (UniqueName: \"kubernetes.io/projected/63c32129-fedf-438d-babc-74629360c9fa-kube-api-access-mspd8\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-dbus\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-498dk\" (UniqueName: \"kubernetes.io/projected/be0588f2-97b8-458d-b985-ee55a71a069e-kube-api-access-498dk\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ba7e57-837a-4474-ba76-e051a733d6cf-ovnkube-config\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-multus\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-sys\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3dacb361-b3f4-495a-ad72-22e0ae551849-host-var-lib-cni-multus\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:05.945877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.943822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be0588f2-97b8-458d-b985-ee55a71a069e-sys\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.946301 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.946039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-etc-tuned\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.946529 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.946490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0588f2-97b8-458d-b985-ee55a71a069e-tmp\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.947327 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.947041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ba7e57-837a-4474-ba76-e051a733d6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.960944 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.960917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg45k\" (UniqueName: \"kubernetes.io/projected/919659c2-ac64-438c-b817-68f1dbc37bca-kube-api-access-zg45k\") pod \"iptables-alerter-mmzzz\" (UID: \"919659c2-ac64-438c-b817-68f1dbc37bca\") " pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:05.963210 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.963183    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-498dk\" (UniqueName: \"kubernetes.io/projected/be0588f2-97b8-458d-b985-ee55a71a069e-kube-api-access-498dk\") pod \"tuned-sh74g\" (UID: \"be0588f2-97b8-458d-b985-ee55a71a069e\") " pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:05.963448 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.963412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcst\" (UniqueName: \"kubernetes.io/projected/d3345e2c-98f0-4e97-b46c-bf0d4bc503f0-kube-api-access-hvcst\") pod \"node-ca-92dsx\" (UID: \"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0\") " pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:05.963549 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.963460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gplgp\" (UniqueName: \"kubernetes.io/projected/fe5e59df-6fbf-4665-b8e8-47c0de3b111b-kube-api-access-gplgp\") pod \"multus-additional-cni-plugins-tbsql\" (UID: \"fe5e59df-6fbf-4665-b8e8-47c0de3b111b\") " pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:05.963974 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.963949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvvb4\" (UniqueName: \"kubernetes.io/projected/0d183d5e-2171-44ed-b326-0d80cc7897db-kube-api-access-vvvb4\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:05.963974 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.963959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv8kf\" (UniqueName: \"kubernetes.io/projected/57ba7e57-837a-4474-ba76-e051a733d6cf-kube-api-access-pv8kf\") pod \"ovnkube-node-b4lcb\" (UID: \"57ba7e57-837a-4474-ba76-e051a733d6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:05.965543 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.965499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspd8\" (UniqueName: \"kubernetes.io/projected/63c32129-fedf-438d-babc-74629360c9fa-kube-api-access-mspd8\") pod \"aws-ebs-csi-driver-node-5cg6m\" (UID: \"63c32129-fedf-438d-babc-74629360c9fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:05.966187 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:05.966118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqtg\" (UniqueName: \"kubernetes.io/projected/3dacb361-b3f4-495a-ad72-22e0ae551849-kube-api-access-njqtg\") pod \"multus-gr9rk\" (UID: \"3dacb361-b3f4-495a-ad72-22e0ae551849\") " pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:06.044317 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-kubelet-config\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0731d0a-d92c-4743-8649-109d1c45ae24-tmp-dir\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-dbus\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-kubelet-config\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0731d0a-d92c-4743-8649-109d1c45ae24-hosts-file\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.044519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0731d0a-d92c-4743-8649-109d1c45ae24-hosts-file\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-konnectivity-ca\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqp8q\" (UniqueName: \"kubernetes.io/projected/c0731d0a-d92c-4743-8649-109d1c45ae24-kube-api-access-nqp8q\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-agent-certs\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.044711    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0731d0a-d92c-4743-8649-109d1c45ae24-tmp-dir\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.044787    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:06.544764921 +0000 UTC m=+3.097372620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:06.044987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.044757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cdb870e-d66f-4a12-b19a-d507d22c8655-dbus\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.045438 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.045235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-konnectivity-ca\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:06.047751 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.047729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9e4ee5f-57f7-4c29-bf36-5bf906f06146-agent-certs\") pod \"konnectivity-agent-s8bzq\" (UID: \"e9e4ee5f-57f7-4c29-bf36-5bf906f06146\") " pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:06.052957 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.052894    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:06.052957 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.052931    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:06.052957 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.052947    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:06.053255 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.053003    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:06.55298959 +0000 UTC m=+3.105597272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:06.056482 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.056455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqp8q\" (UniqueName: \"kubernetes.io/projected/c0731d0a-d92c-4743-8649-109d1c45ae24-kube-api-access-nqp8q\") pod \"node-resolver-zl58p\" (UID: \"c0731d0a-d92c-4743-8649-109d1c45ae24\") " pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.130832 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.130801    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gr9rk"
Sep 16 21:49:06.139035 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.139009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92dsx"
Sep 16 21:49:06.140659 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.140631    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dacb361_b3f4_495a_ad72_22e0ae551849.slice/crio-943547eb2d93a9192157a9acb32bdbd6205e0d8c16c2d80fa6b5ccf297ec3835 WatchSource:0}: Error finding container 943547eb2d93a9192157a9acb32bdbd6205e0d8c16c2d80fa6b5ccf297ec3835: Status 404 returned error can't find the container with id 943547eb2d93a9192157a9acb32bdbd6205e0d8c16c2d80fa6b5ccf297ec3835
Sep 16 21:49:06.149082 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.149047    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3345e2c_98f0_4e97_b46c_bf0d4bc503f0.slice/crio-5910d3bc919ed18897c1ff0c260610a193e273afd26a300f887457cf9ae578ab WatchSource:0}: Error finding container 5910d3bc919ed18897c1ff0c260610a193e273afd26a300f887457cf9ae578ab: Status 404 returned error can't find the container with id 5910d3bc919ed18897c1ff0c260610a193e273afd26a300f887457cf9ae578ab
Sep 16 21:49:06.149620 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.149599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m"
Sep 16 21:49:06.155055 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.155034    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:49:06.157590 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.157558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sh74g"
Sep 16 21:49:06.158425 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.158402    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c32129_fedf_438d_babc_74629360c9fa.slice/crio-8c7bdde58b01afaea92bf52fdef8cb1e08e57b373bf7ac3563803c5ab0e2698b WatchSource:0}: Error finding container 8c7bdde58b01afaea92bf52fdef8cb1e08e57b373bf7ac3563803c5ab0e2698b: Status 404 returned error can't find the container with id 8c7bdde58b01afaea92bf52fdef8cb1e08e57b373bf7ac3563803c5ab0e2698b
Sep 16 21:49:06.165761 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.165732    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0588f2_97b8_458d_b985_ee55a71a069e.slice/crio-7e8dc196ed2496eb2e1306ab66db618e4e75875e1843ee590a2fa35122eed592 WatchSource:0}: Error finding container 7e8dc196ed2496eb2e1306ab66db618e4e75875e1843ee590a2fa35122eed592: Status 404 returned error can't find the container with id 7e8dc196ed2496eb2e1306ab66db618e4e75875e1843ee590a2fa35122eed592
Sep 16 21:49:06.165898 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.165872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:06.174071 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.174048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbsql"
Sep 16 21:49:06.176224 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.176198    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ba7e57_837a_4474_ba76_e051a733d6cf.slice/crio-4d345984837aaa7973e2aac08f9c80f736d992ab1cd3ad9bafb3aabada750961 WatchSource:0}: Error finding container 4d345984837aaa7973e2aac08f9c80f736d992ab1cd3ad9bafb3aabada750961: Status 404 returned error can't find the container with id 4d345984837aaa7973e2aac08f9c80f736d992ab1cd3ad9bafb3aabada750961
Sep 16 21:49:06.183358 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.183329    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5e59df_6fbf_4665_b8e8_47c0de3b111b.slice/crio-2a1a62b05dde9fd7580d3558688a9cb21ba0f6e5954b6f0c2ee7dea4d1e33074 WatchSource:0}: Error finding container 2a1a62b05dde9fd7580d3558688a9cb21ba0f6e5954b6f0c2ee7dea4d1e33074: Status 404 returned error can't find the container with id 2a1a62b05dde9fd7580d3558688a9cb21ba0f6e5954b6f0c2ee7dea4d1e33074
Sep 16 21:49:06.183465 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.183395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmzzz"
Sep 16 21:49:06.192189 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.192158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:06.192283 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.192195    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919659c2_ac64_438c_b817_68f1dbc37bca.slice/crio-5e57f742448b1e89d9481f95d67b974e6d80f88a10c8c9ec870047d7bc25bcd3 WatchSource:0}: Error finding container 5e57f742448b1e89d9481f95d67b974e6d80f88a10c8c9ec870047d7bc25bcd3: Status 404 returned error can't find the container with id 5e57f742448b1e89d9481f95d67b974e6d80f88a10c8c9ec870047d7bc25bcd3
Sep 16 21:49:06.199573 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.199549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zl58p"
Sep 16 21:49:06.200366 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.200340    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e4ee5f_57f7_4c29_bf36_5bf906f06146.slice/crio-07a7c1125f6c680ff054908f0d4f93072ccbd313eb4a0ca9b2c5fa0939a982c5 WatchSource:0}: Error finding container 07a7c1125f6c680ff054908f0d4f93072ccbd313eb4a0ca9b2c5fa0939a982c5: Status 404 returned error can't find the container with id 07a7c1125f6c680ff054908f0d4f93072ccbd313eb4a0ca9b2c5fa0939a982c5
Sep 16 21:49:06.208194 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:06.208167    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0731d0a_d92c_4743_8649_109d1c45ae24.slice/crio-67e054fb67f53f2d2316326d1000838af4b27353a5b758241c3621e270fa2866 WatchSource:0}: Error finding container 67e054fb67f53f2d2316326d1000838af4b27353a5b758241c3621e270fa2866: Status 404 returned error can't find the container with id 67e054fb67f53f2d2316326d1000838af4b27353a5b758241c3621e270fa2866
Sep 16 21:49:06.448706 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.448447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:06.448874 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.448614    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:06.448874 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.448800    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:07.448781334 +0000 UTC m=+4.001389021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:06.549115 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.549070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:06.549285 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.549252    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:06.549363 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.549338    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:07.549310251 +0000 UTC m=+4.101917958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:06.650561 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.650516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:06.650755 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.650679    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:06.650755 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.650702    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:06.650755 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.650713    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:06.650894 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:06.650795    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:07.650775625 +0000 UTC m=+4.203383310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:06.870216 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.870065    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:44:06 +0000 UTC" deadline="2028-06-27 21:06:36.972576476 +0000 UTC"
Sep 16 21:49:06.870216 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.870146    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15599h17m30.102434809s"
Sep 16 21:49:06.930988 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.930943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gr9rk" event={"ID":"3dacb361-b3f4-495a-ad72-22e0ae551849","Type":"ContainerStarted","Data":"943547eb2d93a9192157a9acb32bdbd6205e0d8c16c2d80fa6b5ccf297ec3835"}
Sep 16 21:49:06.932777 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.932745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zl58p" event={"ID":"c0731d0a-d92c-4743-8649-109d1c45ae24","Type":"ContainerStarted","Data":"67e054fb67f53f2d2316326d1000838af4b27353a5b758241c3621e270fa2866"}
Sep 16 21:49:06.934846 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.934818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s8bzq" event={"ID":"e9e4ee5f-57f7-4c29-bf36-5bf906f06146","Type":"ContainerStarted","Data":"07a7c1125f6c680ff054908f0d4f93072ccbd313eb4a0ca9b2c5fa0939a982c5"}
Sep 16 21:49:06.939752 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.939584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmzzz" event={"ID":"919659c2-ac64-438c-b817-68f1dbc37bca","Type":"ContainerStarted","Data":"5e57f742448b1e89d9481f95d67b974e6d80f88a10c8c9ec870047d7bc25bcd3"}
Sep 16 21:49:06.943031 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.943003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"4d345984837aaa7973e2aac08f9c80f736d992ab1cd3ad9bafb3aabada750961"}
Sep 16 21:49:06.945831 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.945755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m" event={"ID":"63c32129-fedf-438d-babc-74629360c9fa","Type":"ContainerStarted","Data":"8c7bdde58b01afaea92bf52fdef8cb1e08e57b373bf7ac3563803c5ab0e2698b"}
Sep 16 21:49:06.947428 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.947353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92dsx" event={"ID":"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0","Type":"ContainerStarted","Data":"5910d3bc919ed18897c1ff0c260610a193e273afd26a300f887457cf9ae578ab"}
Sep 16 21:49:06.949259 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.949207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerStarted","Data":"2a1a62b05dde9fd7580d3558688a9cb21ba0f6e5954b6f0c2ee7dea4d1e33074"}
Sep 16 21:49:06.951785 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:06.951763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sh74g" event={"ID":"be0588f2-97b8-458d-b985-ee55a71a069e","Type":"ContainerStarted","Data":"7e8dc196ed2496eb2e1306ab66db618e4e75875e1843ee590a2fa35122eed592"}
Sep 16 21:49:07.456187 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.456136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:07.456392 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.456277    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:07.456392 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.456352    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:09.456329669 +0000 UTC m=+6.008937369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:07.557474 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.557423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:07.557678 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.557622    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:07.557747 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.557703    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:09.557681017 +0000 UTC m=+6.110288719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:07.658844 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.658799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:07.659041 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.659023    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:07.659109 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.659053    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:07.659109 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.659067    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:07.659254 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.659134    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:09.659113656 +0000 UTC m=+6.211721354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:07.871218 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.871050    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:44:06 +0000 UTC" deadline="2028-02-22 23:08:11.953194273 +0000 UTC"
Sep 16 21:49:07.871218 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.871102    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12577h19m4.082106491s"
Sep 16 21:49:07.920203 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.920160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:07.920358 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.920313    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:07.921354 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.920807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:07.921354 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.920918    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:07.921354 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:07.921151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:07.921354 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:07.921241    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:08.996164 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:08.996037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal" event={"ID":"a262ce05dc84aec0c1c985f6191b9d4d","Type":"ContainerStarted","Data":"88a2e207b853cdc1458e1b9c88a6ad2a4f53aa5969c755db346358506ace607e"}
Sep 16 21:49:09.007334 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.007293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal" event={"ID":"df77dd7cf155c7328de087129b6535d2","Type":"ContainerStarted","Data":"f68461d5a19b6e6e857eb75adf597dfbb5fe9da3697e825ca1162fd5b20045da"}
Sep 16 21:49:09.034365 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.034235    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-103.ec2.internal" podStartSLOduration=4.034210605 podStartE2EDuration="4.034210605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:09.016485584 +0000 UTC m=+5.569093294" watchObservedRunningTime="2026-09-16 21:49:09.034210605 +0000 UTC m=+5.586818313"
Sep 16 21:49:09.485082 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.484335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:09.485082 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.484556    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:09.485082 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.484637    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:13.484614171 +0000 UTC m=+10.037221855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:09.586224 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.585625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:09.586224 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.585777    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:09.586224 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.585841    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:13.585822965 +0000 UTC m=+10.138430652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:09.686678 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.686640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:09.687415 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.686860    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:09.687415 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.686886    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:09.687415 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.686900    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:09.687415 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.686995    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:13.686974376 +0000 UTC m=+10.239582073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:09.922773 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.922694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:09.922952 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.922835    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:09.923369 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.923347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:09.923508 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.923461    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:09.923578 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:09.923530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:09.923671 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:09.923652    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:11.919996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:11.920033    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:11.919996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:11.920156    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:11.920264    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:11.922138 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:11.920353    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:12.018152 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:12.017433    2561 generic.go:356] "Generic (PLEG): container finished" podID="df77dd7cf155c7328de087129b6535d2" containerID="f68461d5a19b6e6e857eb75adf597dfbb5fe9da3697e825ca1162fd5b20045da" exitCode=0
Sep 16 21:49:12.018152 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:12.017488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal" event={"ID":"df77dd7cf155c7328de087129b6535d2","Type":"ContainerDied","Data":"f68461d5a19b6e6e857eb75adf597dfbb5fe9da3697e825ca1162fd5b20045da"}
Sep 16 21:49:13.518155 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.518095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:13.518647 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.518249    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:13.518647 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.518330    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.518308235 +0000 UTC m=+18.070915933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:13.618761 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.618694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:13.618939 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.618860    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:13.618939 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.618936    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.618914299 +0000 UTC m=+18.171521990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:13.720381 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.719965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:13.720381 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.720160    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:13.720381 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.720189    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:13.720381 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.720204    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:13.720381 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.720269    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.720247998 +0000 UTC m=+18.272855696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:13.921171 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.920808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:13.921171 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.920921    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:13.921171 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.921141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:13.921422 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.921262    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:13.921422 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:13.921295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:13.921422 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:13.921342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:15.919241 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:15.919209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:15.919591 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:15.919209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:15.919591 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:15.919319    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:15.919591 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:15.919220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:15.919591 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:15.919452    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:15.919591 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:15.919559    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:17.919313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:17.919285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:17.919313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:17.919285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:17.919920 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:17.919457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:17.919920 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:17.919454    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:17.919920 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:17.919598    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:17.919920 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:17.919675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:19.919956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:19.919918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:19.919956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:19.919940    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:19.920492 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:19.919925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:19.920492 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:19.920068    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:19.920492 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:19.920210    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:19.920492 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:19.920291    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:21.575895 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.575813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:21.576376 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.575972    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:21.576376 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.576042    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:49:37.576021677 +0000 UTC m=+34.128629385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:21.676729 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.676685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:21.676905 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.676830    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:21.676905 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.676895    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:37.676876087 +0000 UTC m=+34.229483781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:21.777612 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.777557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:21.777775 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.777726    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:21.777775 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.777746    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:21.777775 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.777758    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:21.777942 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.777819    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:37.777801597 +0000 UTC m=+34.330409295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:21.919592 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.919511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:21.919592 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.919534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:21.919592 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:21.919511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:21.919873 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.919645    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:21.919873 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.919716    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:21.919873 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:21.919814    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:23.920231 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:23.920196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:23.920634 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:23.920304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:23.920634 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:23.920359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:23.920634 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:23.920487    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:23.920634 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:23.920534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:23.920634 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:23.920609    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:25.045055 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.045029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal" event={"ID":"df77dd7cf155c7328de087129b6535d2","Type":"ContainerStarted","Data":"4d2ab22b2df111370fa40e267447b4650820a63ee65bb85d55a41666090476ad"}
Sep 16 21:49:25.047160 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.046800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zl58p" event={"ID":"c0731d0a-d92c-4743-8649-109d1c45ae24","Type":"ContainerStarted","Data":"d1c2f8b8c565c05b0efb7a22daa20505ad071dea01b702e0841f47dfb36553e4"}
Sep 16 21:49:25.048439 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.048412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s8bzq" event={"ID":"e9e4ee5f-57f7-4c29-bf36-5bf906f06146","Type":"ContainerStarted","Data":"e7fee4382694c37f9950e35bfe8bc7fbee3306d5aec3392a2c7fbd04c6215c47"}
Sep 16 21:49:25.049900 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.049875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92dsx" event={"ID":"d3345e2c-98f0-4e97-b46c-bf0d4bc503f0","Type":"ContainerStarted","Data":"57daceb12f0ea859aa4aa1440fde7406239468c3ca306983ff3687639a5ef0b7"}
Sep 16 21:49:25.073087 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.072967    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-103.ec2.internal" podStartSLOduration=20.072947602 podStartE2EDuration="20.072947602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.06161514 +0000 UTC m=+21.614222846" watchObservedRunningTime="2026-09-16 21:49:25.072947602 +0000 UTC m=+21.625555306"
Sep 16 21:49:25.073398 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.073356    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-92dsx" podStartSLOduration=5.989021796 podStartE2EDuration="21.073342077s" totalImagesPullingTime="15.084320281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.072772249 +0000 UTC m=+21.625379953" watchObservedRunningTime="2026-09-16 21:49:25.073342077 +0000 UTC m=+21.625949780"
Sep 16 21:49:25.919452 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.919224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:25.919698 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.919228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:25.919698 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:25.919484    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:25.919698 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:25.919593    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:25.919698 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:25.919224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:25.919848 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:25.919718    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:26.053399 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.053360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sh74g" event={"ID":"be0588f2-97b8-458d-b985-ee55a71a069e","Type":"ContainerStarted","Data":"02eda787cffaae90d67d6f10820b43ea40f5f3eed96ba5f7eb3f4e46fe6f0440"}
Sep 16 21:49:26.055147 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.055119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gr9rk" event={"ID":"3dacb361-b3f4-495a-ad72-22e0ae551849","Type":"ContainerStarted","Data":"6425923a893f84c4750b30742f88beeab9b4d8d5125d1da63d9c8670e29d34e7"}
Sep 16 21:49:26.058329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058308    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:49:26.058746 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058718    2561 generic.go:356] "Generic (PLEG): container finished" podID="57ba7e57-837a-4474-ba76-e051a733d6cf" containerID="18f8a908880714f76ba11b98fd101de7b234b2cf82af4e30660a6b4361c99cdb" exitCode=1
Sep 16 21:49:26.058822 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"b42be3323bdd85f1ca261c434fa66d4880be7267261c5e5c1d62bbaee2a6a262"}
Sep 16 21:49:26.058883 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"6df255042105f15463645a532ef39adc2861c945306242dd48757428758412a5"}
Sep 16 21:49:26.058921 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"4b5f287e2209c3bcbd86ac16b27dce2d1eb08bd6d0b4364a26180efff84623df"}
Sep 16 21:49:26.058967 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"931fd5153f4a59c0bf91ce0ec0de102725fa8f0b9c4509298a3f58dbeb2fe377"}
Sep 16 21:49:26.059015 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.058986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerDied","Data":"18f8a908880714f76ba11b98fd101de7b234b2cf82af4e30660a6b4361c99cdb"}
Sep 16 21:49:26.059060 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.059020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"48ed07720b350f7e136d7f101aeb7b371a3b897e90dd026a5fd954d92ecff87f"}
Sep 16 21:49:26.060443 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.060423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m" event={"ID":"63c32129-fedf-438d-babc-74629360c9fa","Type":"ContainerStarted","Data":"b18d5f62a95e683f451afad233ce6c68da75cab8caa37406bb3c7f3109ac9839"}
Sep 16 21:49:26.062203 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.062172    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="e97562c9c1421d3e8996b88b84fdd4d0f574364dd096bd9e35b16ed4a6324420" exitCode=0
Sep 16 21:49:26.062301 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.062269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"e97562c9c1421d3e8996b88b84fdd4d0f574364dd096bd9e35b16ed4a6324420"}
Sep 16 21:49:26.068308 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.068268    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sh74g" podStartSLOduration=3.396847001 podStartE2EDuration="22.068251994s" totalImagesPullingTime="18.671404993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:26.067764605 +0000 UTC m=+22.620372342" watchObservedRunningTime="2026-09-16 21:49:26.068251994 +0000 UTC m=+22.620859698"
Sep 16 21:49:26.080599 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.080557    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s8bzq" podStartSLOduration=3.463646477 podStartE2EDuration="22.080542593s" totalImagesPullingTime="18.616896116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:26.080514246 +0000 UTC m=+22.633121951" watchObservedRunningTime="2026-09-16 21:49:26.080542593 +0000 UTC m=+22.633150297"
Sep 16 21:49:26.113362 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.113292    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zl58p" podStartSLOduration=3.504291699 podStartE2EDuration="22.113271377s" totalImagesPullingTime="18.608979678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:26.112565037 +0000 UTC m=+22.665172740" watchObservedRunningTime="2026-09-16 21:49:26.113271377 +0000 UTC m=+22.665879082"
Sep 16 21:49:26.126667 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.126617    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gr9rk" podStartSLOduration=3.096819964 podStartE2EDuration="22.126601684s" totalImagesPullingTime="19.02978172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:26.126040651 +0000 UTC m=+22.678648353" watchObservedRunningTime="2026-09-16 21:49:26.126601684 +0000 UTC m=+22.679209386"
Sep 16 21:49:26.258911 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.258891    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 21:49:26.261266 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.261237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:26.345630 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.345591    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:26.887470 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.887343    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T21:49:26.258908371Z","UUID":"07d80e42-bbff-4b01-9190-f64bcb6af9d4","Handler":null,"Name":"","Endpoint":""}
Sep 16 21:49:26.889864 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.889840    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 21:49:26.889990 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:26.889878    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 21:49:27.067161 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.067122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmzzz" event={"ID":"919659c2-ac64-438c-b817-68f1dbc37bca","Type":"ContainerStarted","Data":"8744234c477b698ec80052830b661958a849f3c0a540c5233b61e631a6a9d0c0"}
Sep 16 21:49:27.069330 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.069303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m" event={"ID":"63c32129-fedf-438d-babc-74629360c9fa","Type":"ContainerStarted","Data":"1a356551b028b46e6046a52e1550730bcb1e052bb399b8d01001e7c95db4d292"}
Sep 16 21:49:27.184928 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.184845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:27.313589 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.313300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:27.413136 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.413065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:27.586011 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.585977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:27.638956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.638923    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:27.919396 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.919286    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:27.919558 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:27.919393    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:27.919558 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.919292    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:27.919558 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:27.919288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:27.919558 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:27.919463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:27.919773 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:27.919584    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:28.075039 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:28.075013    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:49:28.075482 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:28.075457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"15c13a3f98f0cc4c61289e4b4ca8b6151cda18087973c22a0969c5e42164e0da"}
Sep 16 21:49:28.077589 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:28.077561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m" event={"ID":"63c32129-fedf-438d-babc-74629360c9fa","Type":"ContainerStarted","Data":"4b9e64f6a27737bb609026f8c574d2e980507d3a96d8702a3f1694927bf1baca"}
Sep 16 21:49:28.095871 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:28.095819    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mmzzz" podStartSLOduration=5.450917106 podStartE2EDuration="24.095805714s" totalImagesPullingTime="18.644888608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:27.079508871 +0000 UTC m=+23.632116577" watchObservedRunningTime="2026-09-16 21:49:28.095805714 +0000 UTC m=+24.648413477"
Sep 16 21:49:28.096160 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:28.096132    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5cg6m" podStartSLOduration=3.392494134 podStartE2EDuration="24.096123585s" totalImagesPullingTime="20.703629451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:28.095519697 +0000 UTC m=+24.648127404" watchObservedRunningTime="2026-09-16 21:49:28.096123585 +0000 UTC m=+24.648731294"
Sep 16 21:49:29.190861 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:29.190829    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:29.191545 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:29.191516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:29.919562 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:29.919490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:29.919712 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:29.919491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:29.919712 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:29.919614    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:29.919712 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:29.919494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:29.919712 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:29.919693    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:29.919916 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:29.919784    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:30.083329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:30.083290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:30.083828 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:30.083807    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s8bzq"
Sep 16 21:49:30.137885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:30.137845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:31.089279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.089091    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:49:31.089675 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.089640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"0be5b92926f1afde99b66eb52bff0512969d1375845e5b35aeaef2718ba8d560"}
Sep 16 21:49:31.089928 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.089893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:31.090035 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.089956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:31.090138 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.090118    2561 scope.go:117] "RemoveContainer" containerID="18f8a908880714f76ba11b98fd101de7b234b2cf82af4e30660a6b4361c99cdb"
Sep 16 21:49:31.091654 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.091628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerStarted","Data":"1f1961a7d142c100c50bda989bc393e3ec3a69d7bbe2f87795bf13158acd6ff3"}
Sep 16 21:49:31.110371 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.110347    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:31.922707 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.922675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:31.923076 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:31.922825    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:31.923076 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.922912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:31.923076 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:31.923009    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:31.923076 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:31.923064    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:31.923367 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:31.923156    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:32.099203 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.099170    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:49:32.099851 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.099680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" event={"ID":"57ba7e57-837a-4474-ba76-e051a733d6cf","Type":"ContainerStarted","Data":"84fdc99c003a39e0c000379f5db0075f8280d06a157373d95b385f8a386a8c17"}
Sep 16 21:49:32.100386 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.100366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:32.102597 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.102574    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="1f1961a7d142c100c50bda989bc393e3ec3a69d7bbe2f87795bf13158acd6ff3" exitCode=0
Sep 16 21:49:32.102722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.102614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"1f1961a7d142c100c50bda989bc393e3ec3a69d7bbe2f87795bf13158acd6ff3"}
Sep 16 21:49:32.116274 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.116255    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:49:32.123895 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.123857    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb" podStartSLOduration=9.414137106 podStartE2EDuration="28.123843926s" totalImagesPullingTime="18.70970682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:32.122677429 +0000 UTC m=+28.675285132" watchObservedRunningTime="2026-09-16 21:49:32.123843926 +0000 UTC m=+28.676451628"
Sep 16 21:49:32.517506 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.517474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pbqpr"]
Sep 16 21:49:32.517685 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.517594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:32.517744 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:32.517713    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:32.521147 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.521118    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cggth"]
Sep 16 21:49:32.521311 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.521256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:32.521393 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:32.521371    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:32.521843 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.521814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njx9t"]
Sep 16 21:49:32.521968 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:32.521905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:32.522037 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:32.521989    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:33.924151 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:33.921957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:33.924151 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:33.922366    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:34.109158 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:34.109126    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="a8494ea524f44e398a203c5d3c77a96f1b83557d1737950edaaedbc9a7365df6" exitCode=0
Sep 16 21:49:34.109349 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:34.109214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"a8494ea524f44e398a203c5d3c77a96f1b83557d1737950edaaedbc9a7365df6"}
Sep 16 21:49:34.919328 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:34.919289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:34.919494 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:34.919398    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:34.919494 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:34.919449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:34.919577 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:34.919535    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:35.114181 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:35.114152    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="9809b63051243589c5db5c180f25940f26d3efe67fdfe1e7ca52ef80d8111471" exitCode=0
Sep 16 21:49:35.114589 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:35.114195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"9809b63051243589c5db5c180f25940f26d3efe67fdfe1e7ca52ef80d8111471"}
Sep 16 21:49:35.919595 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:35.919560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:35.919777 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:35.919720    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:49:36.919552 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:36.919515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:36.919552 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:36.919531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:36.920012 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:36.919634    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbqpr" podUID="4cdb870e-d66f-4a12-b19a-d507d22c8655"
Sep 16 21:49:36.920012 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:36.919736    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njx9t" podUID="3574eab6-038a-44b6-a371-25f70bec2207"
Sep 16 21:49:37.595366 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.595335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:37.595517 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.595493    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:37.595581 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.595569    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:50:09.595551303 +0000 UTC m=+66.148158997 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:37.696215 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.696181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:37.696390 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.696349    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:37.696442 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.696415    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret podName:4cdb870e-d66f-4a12-b19a-d507d22c8655 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:09.696400375 +0000 UTC m=+66.249008076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret") pod "global-pull-secret-syncer-pbqpr" (UID: "4cdb870e-d66f-4a12-b19a-d507d22c8655") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:37.729896 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.729871    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-103.ec2.internal" event="NodeReady"
Sep 16 21:49:37.730029 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.729990    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 21:49:37.769946 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.769916    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lsnmt"]
Sep 16 21:49:37.796952 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.796917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:37.797124 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.797048    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:37.797124 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.797065    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:37.797124 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.797078    2561 projected.go:196] Error preparing data for projected volume kube-api-access-xr8p8 for pod openshift-network-diagnostics/network-check-target-njx9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:37.797308 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.797147    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8 podName:3574eab6-038a-44b6-a371-25f70bec2207 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:09.797132868 +0000 UTC m=+66.349740549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr8p8" (UniqueName: "kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8") pod "network-check-target-njx9t" (UID: "3574eab6-038a-44b6-a371-25f70bec2207") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:37.810019 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.809939    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f2glq"]
Sep 16 21:49:37.810174 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.810087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.812269 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.812245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 21:49:37.812425 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.812319    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\""
Sep 16 21:49:37.812601 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.812578    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 21:49:37.823342 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.823321    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsnmt"]
Sep 16 21:49:37.823474 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.823364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2glq"]
Sep 16 21:49:37.823474 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.823443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:37.825563 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.825521    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 21:49:37.825775 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.825754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7xfr\""
Sep 16 21:49:37.825775 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.825774    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 21:49:37.825928 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.825754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 21:49:37.897229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.897192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92df0d08-c192-4d3e-a313-3c45be57210e-tmp-dir\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.897229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.897232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpsc4\" (UniqueName: \"kubernetes.io/projected/92df0d08-c192-4d3e-a313-3c45be57210e-kube-api-access-mpsc4\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.897435 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.897284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92df0d08-c192-4d3e-a313-3c45be57210e-config-volume\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.897435 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.897328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.919354 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.919325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:49:37.921877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.921854    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 21:49:37.922207 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.921903    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\""
Sep 16 21:49:37.998714 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92df0d08-c192-4d3e-a313-3c45be57210e-config-volume\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.998888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.998888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92df0d08-c192-4d3e-a313-3c45be57210e-tmp-dir\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.998888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpsc4\" (UniqueName: \"kubernetes.io/projected/92df0d08-c192-4d3e-a313-3c45be57210e-kube-api-access-mpsc4\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.998888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-cert\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:37.998888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.998874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65lhg\" (UniqueName: \"kubernetes.io/projected/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-kube-api-access-65lhg\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:37.999180 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.998935    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:37.999180 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:37.999021    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:38.499001816 +0000 UTC m=+35.051609497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:37.999356 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.999203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92df0d08-c192-4d3e-a313-3c45be57210e-tmp-dir\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:37.999356 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:37.999337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92df0d08-c192-4d3e-a313-3c45be57210e-config-volume\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:38.008944 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.008918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpsc4\" (UniqueName: \"kubernetes.io/projected/92df0d08-c192-4d3e-a313-3c45be57210e-kube-api-access-mpsc4\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:38.100050 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.099971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-cert\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:38.100050 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.100036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65lhg\" (UniqueName: \"kubernetes.io/projected/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-kube-api-access-65lhg\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:38.102368 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.102331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-cert\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:38.109391 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.109366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65lhg\" (UniqueName: \"kubernetes.io/projected/42f360e7-fbf8-483b-8df4-27fc1b21fdc8-kube-api-access-65lhg\") pod \"ingress-canary-f2glq\" (UID: \"42f360e7-fbf8-483b-8df4-27fc1b21fdc8\") " pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:38.133208 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.133176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2glq"
Sep 16 21:49:38.503417 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.503323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:38.503578 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:38.503473    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:38.503578 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:38.503549    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:39.503529906 +0000 UTC m=+36.056137589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:38.919199 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.919163    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:49:38.919199 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.919186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:49:38.921726 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.921703    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 21:49:38.922268 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.922247    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 21:49:38.922615 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.922308    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 21:49:38.922615 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:38.922332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\""
Sep 16 21:49:39.511185 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:39.511143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:39.515199 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:39.511347    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:39.515199 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:39.511422    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:41.511396281 +0000 UTC m=+38.064003982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:39.915671 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:39.915597    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2glq"]
Sep 16 21:49:39.919758 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:49:39.919736    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f360e7_fbf8_483b_8df4_27fc1b21fdc8.slice/crio-943c33cfd6c9def03380ff95faaf24d71cd5199bcb2b6ab3f7f1abb4d3035754 WatchSource:0}: Error finding container 943c33cfd6c9def03380ff95faaf24d71cd5199bcb2b6ab3f7f1abb4d3035754: Status 404 returned error can't find the container with id 943c33cfd6c9def03380ff95faaf24d71cd5199bcb2b6ab3f7f1abb4d3035754
Sep 16 21:49:40.130799 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:40.130765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerStarted","Data":"f54d234ae9dc627156d6cf10cc379a0edd8d6746e680a461754ef9472f4b3f31"}
Sep 16 21:49:40.132156 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:40.132122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2glq" event={"ID":"42f360e7-fbf8-483b-8df4-27fc1b21fdc8","Type":"ContainerStarted","Data":"943c33cfd6c9def03380ff95faaf24d71cd5199bcb2b6ab3f7f1abb4d3035754"}
Sep 16 21:49:41.137685 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:41.137623    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="f54d234ae9dc627156d6cf10cc379a0edd8d6746e680a461754ef9472f4b3f31" exitCode=0
Sep 16 21:49:41.138186 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:41.137679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"f54d234ae9dc627156d6cf10cc379a0edd8d6746e680a461754ef9472f4b3f31"}
Sep 16 21:49:41.526520 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:41.526452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:41.526653 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:41.526566    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:41.526653 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:41.526626    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:45.526609884 +0000 UTC m=+42.079217584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:42.144458 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:42.144426    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe5e59df-6fbf-4665-b8e8-47c0de3b111b" containerID="eefaee9f1a620c7dcc1f21eca2cadf42ef22d5a8a234276fe6e33d690df404ed" exitCode=0
Sep 16 21:49:42.144882 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:42.144472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerDied","Data":"eefaee9f1a620c7dcc1f21eca2cadf42ef22d5a8a234276fe6e33d690df404ed"}
Sep 16 21:49:43.148600 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:43.148560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2glq" event={"ID":"42f360e7-fbf8-483b-8df4-27fc1b21fdc8","Type":"ContainerStarted","Data":"958bf3cb7162f8720ce125e8421e411ead516868c3997d2bb2afb8c98eeba224"}
Sep 16 21:49:43.151779 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:43.151741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbsql" event={"ID":"fe5e59df-6fbf-4665-b8e8-47c0de3b111b","Type":"ContainerStarted","Data":"759568a53b7a7fe15d3fff8988b61a9eaf5e01b31455e6e56b775ecbb721a2f9"}
Sep 16 21:49:43.163134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:43.163075    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f2glq" podStartSLOduration=3.482466566 podStartE2EDuration="6.163062753s" totalImagesPullingTime="2.680596187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:43.162020454 +0000 UTC m=+39.714628158" watchObservedRunningTime="2026-09-16 21:49:43.163062753 +0000 UTC m=+39.715670485"
Sep 16 21:49:43.179218 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:43.179173    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tbsql" podStartSLOduration=9.299327182 podStartE2EDuration="39.179155494s" totalImagesPullingTime="29.879828312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:43.17878539 +0000 UTC m=+39.731393095" watchObservedRunningTime="2026-09-16 21:49:43.179155494 +0000 UTC m=+39.731763235"
Sep 16 21:49:45.555597 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:45.555558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:45.555964 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:45.555677    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:45.555964 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:45.555729    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:53.555716255 +0000 UTC m=+50.108323950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:53.610908 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:49:53.610863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:49:53.611370 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:53.611012    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:53.611370 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:49:53.611089    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:50:09.611071854 +0000 UTC m=+66.163679549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:50:04.119541 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:04.119513    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b4lcb"
Sep 16 21:50:09.624277 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.624229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:50:09.624277 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.624290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:50:09.624732 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:09.624388    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:50:09.624732 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:09.624452    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:50:41.624433835 +0000 UTC m=+98.177041516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:50:09.626715 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.626695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 21:50:09.634884 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:09.634859    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:50:09.634982 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:09.634943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:51:13.634920715 +0000 UTC m=+130.187528412 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : secret "metrics-daemon-secret" not found
Sep 16 21:50:09.724945 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.724904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:50:09.727217 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.727197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 21:50:09.738677 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.738651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cdb870e-d66f-4a12-b19a-d507d22c8655-original-pull-secret\") pod \"global-pull-secret-syncer-pbqpr\" (UID: \"4cdb870e-d66f-4a12-b19a-d507d22c8655\") " pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:50:09.825362 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.825314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:50:09.827388 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.827369    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 21:50:09.831732 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.831718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbqpr"
Sep 16 21:50:09.837603 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.837583    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 21:50:09.849466 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:09.849442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8p8\" (UniqueName: \"kubernetes.io/projected/3574eab6-038a-44b6-a371-25f70bec2207-kube-api-access-xr8p8\") pod \"network-check-target-njx9t\" (UID: \"3574eab6-038a-44b6-a371-25f70bec2207\") " pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:50:10.096574 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:10.096542    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pbqpr"]
Sep 16 21:50:10.100144 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:50:10.100119    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdb870e_d66f_4a12_b19a_d507d22c8655.slice/crio-4c0c42fb99d62d566e1a0f6a6046f7e6e628505281e3f3bd138889d1a7ea9bad WatchSource:0}: Error finding container 4c0c42fb99d62d566e1a0f6a6046f7e6e628505281e3f3bd138889d1a7ea9bad: Status 404 returned error can't find the container with id 4c0c42fb99d62d566e1a0f6a6046f7e6e628505281e3f3bd138889d1a7ea9bad
Sep 16 21:50:10.140062 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:10.139990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\""
Sep 16 21:50:10.148474 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:10.148456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:50:10.217244 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:10.217213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pbqpr" event={"ID":"4cdb870e-d66f-4a12-b19a-d507d22c8655","Type":"ContainerStarted","Data":"4c0c42fb99d62d566e1a0f6a6046f7e6e628505281e3f3bd138889d1a7ea9bad"}
Sep 16 21:50:10.410946 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:10.410871    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njx9t"]
Sep 16 21:50:10.414259 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:50:10.414234    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3574eab6_038a_44b6_a371_25f70bec2207.slice/crio-d66cd1e190748ede082537b484fd3a9e3deab6b4e0f72bebd9165ef89ad65e22 WatchSource:0}: Error finding container d66cd1e190748ede082537b484fd3a9e3deab6b4e0f72bebd9165ef89ad65e22: Status 404 returned error can't find the container with id d66cd1e190748ede082537b484fd3a9e3deab6b4e0f72bebd9165ef89ad65e22
Sep 16 21:50:11.222344 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:11.222307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njx9t" event={"ID":"3574eab6-038a-44b6-a371-25f70bec2207","Type":"ContainerStarted","Data":"d66cd1e190748ede082537b484fd3a9e3deab6b4e0f72bebd9165ef89ad65e22"}
Sep 16 21:50:16.236931 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:16.236892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pbqpr" event={"ID":"4cdb870e-d66f-4a12-b19a-d507d22c8655","Type":"ContainerStarted","Data":"2a4ce16b7e97d6dd282a22f0aa7b1638f0369b3735e59999528620f147cc90b6"}
Sep 16 21:50:16.238337 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:16.238315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njx9t" event={"ID":"3574eab6-038a-44b6-a371-25f70bec2207","Type":"ContainerStarted","Data":"6d2f10445a05be0aa0c760317f0bc3a5d41a29b80b38ac75098a6114022af803"}
Sep 16 21:50:16.238451 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:16.238357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:50:16.249864 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:16.249819    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pbqpr" podStartSLOduration=66.732951685 podStartE2EDuration="1m12.249806508s" totalImagesPullingTime="5.516854823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:50:16.249276772 +0000 UTC m=+72.801884475" watchObservedRunningTime="2026-09-16 21:50:16.249806508 +0000 UTC m=+72.802414203"
Sep 16 21:50:16.261913 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:16.261879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-njx9t" podStartSLOduration=67.070112273 podStartE2EDuration="1m12.261866966s" totalImagesPullingTime="5.191754693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:50:16.261720709 +0000 UTC m=+72.814328413" watchObservedRunningTime="2026-09-16 21:50:16.261866966 +0000 UTC m=+72.814474700"
Sep 16 21:50:41.632046 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:41.631994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:50:41.632540 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:41.632156    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:50:41.632540 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:50:41.632225    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:51:45.632206131 +0000 UTC m=+162.184813816 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:50:47.243804 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:50:47.243770    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-njx9t"
Sep 16 21:51:13.646556 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:51:13.646503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:51:13.646973 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:13.646662    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:51:13.646973 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:13.646732    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:53:15.646715297 +0000 UTC m=+252.199322982 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : secret "metrics-daemon-secret" not found
Sep 16 21:51:40.820791 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:40.820732    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lsnmt" podUID="92df0d08-c192-4d3e-a313-3c45be57210e"
Sep 16 21:51:40.927926 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:40.927877    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:51:41.445022 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:51:41.444988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:51:45.662376 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:51:45.662340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:51:45.662774 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:45.662482    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:51:45.662774 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:51:45.662568    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls podName:92df0d08-c192-4d3e-a313-3c45be57210e nodeName:}" failed. No retries permitted until 2026-09-16 21:53:47.6625498 +0000 UTC m=+284.215157499 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls") pod "dns-default-lsnmt" (UID: "92df0d08-c192-4d3e-a313-3c45be57210e") : secret "dns-default-metrics-tls" not found
Sep 16 21:51:55.920091 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:51:55.920051    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:53:13.022655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.022618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-d9xq5"]
Sep 16 21:53:13.024299 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.024282    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"]
Sep 16 21:53:13.024424 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.024405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.027986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.027084    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 16 21:53:13.027986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.027396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 16 21:53:13.027986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.027693    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 21:53:13.027986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.027782    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 21:53:13.027986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.027698    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xcz9j\""
Sep 16 21:53:13.030971 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.030946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"
Sep 16 21:53:13.033466 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.033425    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 16 21:53:13.033648 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.033628    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:53:13.033730 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.033714    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hgbkh\""
Sep 16 21:53:13.033958 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.033943    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 21:53:13.042581 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.042547    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"]
Sep 16 21:53:13.043424 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.043401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-d9xq5"]
Sep 16 21:53:13.121255 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.121224    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"]
Sep 16 21:53:13.123156 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.123133    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nl2qg"]
Sep 16 21:53:13.123290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.123227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.124856 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.124835    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b5fb467cd-qxv9d"]
Sep 16 21:53:13.124966 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.124951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.125048 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.125034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 21:53:13.125201 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.125181    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 21:53:13.125714 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.125696    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:53:13.125796 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.125752    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tnz47\""
Sep 16 21:53:13.126481 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.126464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.126947 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.126930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 16 21:53:13.127047 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.126994    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 16 21:53:13.127047 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.127008    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:53:13.127047 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.127038    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vkxgd\""
Sep 16 21:53:13.127396 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.127379    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 16 21:53:13.128203 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.128186    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 16 21:53:13.128279 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.128248    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 16 21:53:13.128414 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.128395    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 16 21:53:13.128819 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.128801    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 21:53:13.129146 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.129129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 16 21:53:13.129483 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.129463    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 21:53:13.129625 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.129606    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bsqj2\""
Sep 16 21:53:13.132351 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjt9x\" (UniqueName: \"kubernetes.io/projected/68f68988-945c-499f-bfe8-cff969e494a4-kube-api-access-mjt9x\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.132473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnn9\" (UniqueName: \"kubernetes.io/projected/fdcf1b13-0a17-423a-9768-211450403daa-kube-api-access-jmnn9\") pod \"volume-data-source-validator-86695b7cc7-jqpnk\" (UID: \"fdcf1b13-0a17-423a-9768-211450403daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"
Sep 16 21:53:13.132473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68f68988-945c-499f-bfe8-cff969e494a4-serving-cert\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.132473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132409    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-snapshots\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.132645 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-tmp\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.132645 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-service-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.132645 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.132599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-trusted-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.133999 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.133977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"]
Sep 16 21:53:13.134978 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.134955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nl2qg"]
Sep 16 21:53:13.135118 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.135028    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 16 21:53:13.151688 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.151658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b5fb467cd-qxv9d"]
Sep 16 21:53:13.233582 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e48c365-2533-4f3f-992b-663445e65bd9-serving-cert\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjt9x\" (UniqueName: \"kubernetes.io/projected/68f68988-945c-499f-bfe8-cff969e494a4-kube-api-access-mjt9x\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnn9\" (UniqueName: \"kubernetes.io/projected/fdcf1b13-0a17-423a-9768-211450403daa-kube-api-access-jmnn9\") pod \"volume-data-source-validator-86695b7cc7-jqpnk\" (UID: \"fdcf1b13-0a17-423a-9768-211450403daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68f68988-945c-499f-bfe8-cff969e494a4-serving-cert\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shxp4\" (UniqueName: \"kubernetes.io/projected/71a82df3-a979-4a4a-8893-7600705138a4-kube-api-access-shxp4\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-trusted-ca\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.233783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4lk\" (UniqueName: \"kubernetes.io/projected/6e48c365-2533-4f3f-992b-663445e65bd9-kube-api-access-xh4lk\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.234010 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-default-certificate\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.234010 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233878    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfg7d\" (UniqueName: \"kubernetes.io/projected/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-kube-api-access-wfg7d\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.234010 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-snapshots\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234010 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.234010 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.233979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-tmp\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-stats-auth\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-service-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-trusted-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-config\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.234533 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-tmp\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234620 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68f68988-945c-499f-bfe8-cff969e494a4-snapshots\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.234677 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.234626    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-service-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.235083 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.235059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f68988-945c-499f-bfe8-cff969e494a4-trusted-ca-bundle\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.236013 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.235991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68f68988-945c-499f-bfe8-cff969e494a4-serving-cert\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.243202 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.243180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjt9x\" (UniqueName: \"kubernetes.io/projected/68f68988-945c-499f-bfe8-cff969e494a4-kube-api-access-mjt9x\") pod \"insights-operator-5844b856db-d9xq5\" (UID: \"68f68988-945c-499f-bfe8-cff969e494a4\") " pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.243595 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.243574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnn9\" (UniqueName: \"kubernetes.io/projected/fdcf1b13-0a17-423a-9768-211450403daa-kube-api-access-jmnn9\") pod \"volume-data-source-validator-86695b7cc7-jqpnk\" (UID: \"fdcf1b13-0a17-423a-9768-211450403daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"
Sep 16 21:53:13.335252 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-config\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e48c365-2533-4f3f-992b-663445e65bd9-serving-cert\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shxp4\" (UniqueName: \"kubernetes.io/projected/71a82df3-a979-4a4a-8893-7600705138a4-kube-api-access-shxp4\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-trusted-ca\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4lk\" (UniqueName: \"kubernetes.io/projected/6e48c365-2533-4f3f-992b-663445e65bd9-kube-api-access-xh4lk\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-default-certificate\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfg7d\" (UniqueName: \"kubernetes.io/projected/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-kube-api-access-wfg7d\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.335444 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-stats-auth\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.335628    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.335660    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:13.835640967 +0000 UTC m=+250.388248649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.335688    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls podName:71a82df3-a979-4a4a-8893-7600705138a4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:13.835679251 +0000 UTC m=+250.388286932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qd6cj" (UID: "71a82df3-a979-4a4a-8893-7600705138a4") : secret "samples-operator-tls" not found
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.335726    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 21:53:13.335826 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.335762    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:13.835747329 +0000 UTC m=+250.388355018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : secret "router-metrics-certs-default" not found
Sep 16 21:53:13.336234 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.335837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-d9xq5"
Sep 16 21:53:13.336234 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.336053    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-config\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.336234 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.336151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e48c365-2533-4f3f-992b-663445e65bd9-trusted-ca\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.337882 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.337856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e48c365-2533-4f3f-992b-663445e65bd9-serving-cert\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.338006 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.337983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-stats-auth\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.338140 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.338122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-default-certificate\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.340546 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.340529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"
Sep 16 21:53:13.343045 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.343024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shxp4\" (UniqueName: \"kubernetes.io/projected/71a82df3-a979-4a4a-8893-7600705138a4-kube-api-access-shxp4\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.343173 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.343153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfg7d\" (UniqueName: \"kubernetes.io/projected/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-kube-api-access-wfg7d\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.343344 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.343326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4lk\" (UniqueName: \"kubernetes.io/projected/6e48c365-2533-4f3f-992b-663445e65bd9-kube-api-access-xh4lk\") pod \"console-operator-696884fb9c-nl2qg\" (UID: \"6e48c365-2533-4f3f-992b-663445e65bd9\") " pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.441060 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.441021    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:13.606658 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.606586    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-d9xq5"]
Sep 16 21:53:13.608883 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.608859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk"]
Sep 16 21:53:13.609949 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:13.609925    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f68988_945c_499f_bfe8_cff969e494a4.slice/crio-a79f4bbe746a1a84328aefe8e658de4bad418493ac6d184b62b8b47626072521 WatchSource:0}: Error finding container a79f4bbe746a1a84328aefe8e658de4bad418493ac6d184b62b8b47626072521: Status 404 returned error can't find the container with id a79f4bbe746a1a84328aefe8e658de4bad418493ac6d184b62b8b47626072521
Sep 16 21:53:13.612396 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:13.612373    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcf1b13_0a17_423a_9768_211450403daa.slice/crio-21cc7b2adb4d8dd36db8aca9f86007821f455406cb982078da2248515af492e8 WatchSource:0}: Error finding container 21cc7b2adb4d8dd36db8aca9f86007821f455406cb982078da2248515af492e8: Status 404 returned error can't find the container with id 21cc7b2adb4d8dd36db8aca9f86007821f455406cb982078da2248515af492e8
Sep 16 21:53:13.665142 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.665091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-d9xq5" event={"ID":"68f68988-945c-499f-bfe8-cff969e494a4","Type":"ContainerStarted","Data":"a79f4bbe746a1a84328aefe8e658de4bad418493ac6d184b62b8b47626072521"}
Sep 16 21:53:13.666267 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.666242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk" event={"ID":"fdcf1b13-0a17-423a-9768-211450403daa","Type":"ContainerStarted","Data":"21cc7b2adb4d8dd36db8aca9f86007821f455406cb982078da2248515af492e8"}
Sep 16 21:53:13.718656 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.718629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nl2qg"]
Sep 16 21:53:13.721756 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:13.721730    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e48c365_2533_4f3f_992b_663445e65bd9.slice/crio-71b52b108ace6a048e749760fbee30e15b728441236ed178e7b58d03b93f2547 WatchSource:0}: Error finding container 71b52b108ace6a048e749760fbee30e15b728441236ed178e7b58d03b93f2547: Status 404 returned error can't find the container with id 71b52b108ace6a048e749760fbee30e15b728441236ed178e7b58d03b93f2547
Sep 16 21:53:13.839072 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.839026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.839072 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.839074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:13.839346 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:13.839093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:13.839346 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.839244    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 21:53:13.839346 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.839249    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:14.839226681 +0000 UTC m=+251.391834370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:13.839346 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.839295    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 21:53:13.839346 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.839302    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls podName:71a82df3-a979-4a4a-8893-7600705138a4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:14.839290185 +0000 UTC m=+251.391897866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qd6cj" (UID: "71a82df3-a979-4a4a-8893-7600705138a4") : secret "samples-operator-tls" not found
Sep 16 21:53:13.839586 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:13.839354    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:14.839343776 +0000 UTC m=+251.391951458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : secret "router-metrics-certs-default" not found
Sep 16 21:53:14.670991 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.670903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" event={"ID":"6e48c365-2533-4f3f-992b-663445e65bd9","Type":"ContainerStarted","Data":"71b52b108ace6a048e749760fbee30e15b728441236ed178e7b58d03b93f2547"}
Sep 16 21:53:14.673299 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.673236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk" event={"ID":"fdcf1b13-0a17-423a-9768-211450403daa","Type":"ContainerStarted","Data":"0e486bc18ff872c65d68709c61f907809affc9fb99d6e81ece3fde2c15c43ee7"}
Sep 16 21:53:14.687257 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.687194    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-jqpnk" podStartSLOduration=0.700446044 podStartE2EDuration="1.687168382s" totalImagesPullingTime="986.722338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:14.686037102 +0000 UTC m=+251.238644804" watchObservedRunningTime="2026-09-16 21:53:14.687168382 +0000 UTC m=+251.239776087"
Sep 16 21:53:14.846963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.846918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:14.847173 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.846982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:14.847173 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:14.847017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:14.847173 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:14.847136    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:16.84708847 +0000 UTC m=+253.399696156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:14.847350 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:14.847178    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 21:53:14.847350 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:14.847233    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls podName:71a82df3-a979-4a4a-8893-7600705138a4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:16.847216427 +0000 UTC m=+253.399824109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qd6cj" (UID: "71a82df3-a979-4a4a-8893-7600705138a4") : secret "samples-operator-tls" not found
Sep 16 21:53:14.847350 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:14.847290    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 21:53:14.847350 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:14.847321    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:16.847309506 +0000 UTC m=+253.399917190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : secret "router-metrics-certs-default" not found
Sep 16 21:53:15.654794 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:15.654755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:53:15.655009 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:15.654919    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:53:15.655009 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:15.654996    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs podName:0d183d5e-2171-44ed-b326-0d80cc7897db nodeName:}" failed. No retries permitted until 2026-09-16 21:55:17.654977699 +0000 UTC m=+374.207585394 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs") pod "network-metrics-daemon-cggth" (UID: "0d183d5e-2171-44ed-b326-0d80cc7897db") : secret "metrics-daemon-secret" not found
Sep 16 21:53:16.681594 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.681554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-d9xq5" event={"ID":"68f68988-945c-499f-bfe8-cff969e494a4","Type":"ContainerStarted","Data":"29e463676d12f36530a503861c21cee94f8dea16397ce71479ec0a7e695b754c"}
Sep 16 21:53:16.683218 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.683200    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/0.log"
Sep 16 21:53:16.683320 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.683234    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e48c365-2533-4f3f-992b-663445e65bd9" containerID="9f429ec6e052038345de3f267c2c9de6bd9c536d6e81c92e26f5a72fef59e0af" exitCode=255
Sep 16 21:53:16.683320 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.683285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" event={"ID":"6e48c365-2533-4f3f-992b-663445e65bd9","Type":"ContainerDied","Data":"9f429ec6e052038345de3f267c2c9de6bd9c536d6e81c92e26f5a72fef59e0af"}
Sep 16 21:53:16.683478 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.683465    2561 scope.go:117] "RemoveContainer" containerID="9f429ec6e052038345de3f267c2c9de6bd9c536d6e81c92e26f5a72fef59e0af"
Sep 16 21:53:16.698291 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.698246    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-d9xq5" podStartSLOduration=1.077747405 podStartE2EDuration="3.698229609s" totalImagesPullingTime="2.620482204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:16.698083113 +0000 UTC m=+253.250690819" watchObservedRunningTime="2026-09-16 21:53:16.698229609 +0000 UTC m=+253.250837313"
Sep 16 21:53:16.863530 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.863479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.863541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:16.863571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:16.863662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:20.863637261 +0000 UTC m=+257.416244945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:16.863676    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:16.863693    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 21:53:16.863734 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:16.863734    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:20.863716228 +0000 UTC m=+257.416323909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : secret "router-metrics-certs-default" not found
Sep 16 21:53:16.864026 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:16.863749    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls podName:71a82df3-a979-4a4a-8893-7600705138a4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:20.86374248 +0000 UTC m=+257.416350161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qd6cj" (UID: "71a82df3-a979-4a4a-8893-7600705138a4") : secret "samples-operator-tls" not found
Sep 16 21:53:17.687480 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.687455    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/1.log"
Sep 16 21:53:17.687932 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.687865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/0.log"
Sep 16 21:53:17.687932 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.687899    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e48c365-2533-4f3f-992b-663445e65bd9" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab" exitCode=255
Sep 16 21:53:17.687999 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.687978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" event={"ID":"6e48c365-2533-4f3f-992b-663445e65bd9","Type":"ContainerDied","Data":"453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"}
Sep 16 21:53:17.688076 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.688062    2561 scope.go:117] "RemoveContainer" containerID="9f429ec6e052038345de3f267c2c9de6bd9c536d6e81c92e26f5a72fef59e0af"
Sep 16 21:53:17.688397 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.688369    2561 scope.go:117] "RemoveContainer" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"
Sep 16 21:53:17.688570 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:17.688551    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:17.690432 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.690413    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"]
Sep 16 21:53:17.692278 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.692264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"
Sep 16 21:53:17.694305 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.694281    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 21:53:17.694305 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.694298    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x44hh\""
Sep 16 21:53:17.694460 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.694321    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 21:53:17.703781 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.703758    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"]
Sep 16 21:53:17.770511 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.770466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8ns\" (UniqueName: \"kubernetes.io/projected/7e87bdec-f51b-4aa4-945c-d5de70e4b0a6-kube-api-access-6r8ns\") pod \"migrator-8b4d697c5-vnmw7\" (UID: \"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"
Sep 16 21:53:17.871302 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.871264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8ns\" (UniqueName: \"kubernetes.io/projected/7e87bdec-f51b-4aa4-945c-d5de70e4b0a6-kube-api-access-6r8ns\") pod \"migrator-8b4d697c5-vnmw7\" (UID: \"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"
Sep 16 21:53:17.878048 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:17.878019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8ns\" (UniqueName: \"kubernetes.io/projected/7e87bdec-f51b-4aa4-945c-d5de70e4b0a6-kube-api-access-6r8ns\") pod \"migrator-8b4d697c5-vnmw7\" (UID: \"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"
Sep 16 21:53:18.005293 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.005215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"
Sep 16 21:53:18.012665 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.012638    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qcd54"]
Sep 16 21:53:18.016970 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.016945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.018877 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.018850    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 21:53:18.018987 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.018900    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 21:53:18.019315 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.019297    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbdm9\""
Sep 16 21:53:18.025944 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.025918    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcd54"]
Sep 16 21:53:18.073673 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.073634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b65400e-ae1a-4a8c-a074-54e628e4acf8-data-volume\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.073828 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.073713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfbh\" (UniqueName: \"kubernetes.io/projected/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-api-access-djfbh\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.073894 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.073822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.073894 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.073865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b65400e-ae1a-4a8c-a074-54e628e4acf8-crio-socket\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.073983 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.073959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.174856 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.174819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b65400e-ae1a-4a8c-a074-54e628e4acf8-data-volume\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175027 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.174868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfbh\" (UniqueName: \"kubernetes.io/projected/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-api-access-djfbh\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175027 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.174899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175027 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.174927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b65400e-ae1a-4a8c-a074-54e628e4acf8-crio-socket\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175027 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.174983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175213 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.175044    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.175213 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.175068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b65400e-ae1a-4a8c-a074-54e628e4acf8-crio-socket\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175213 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.175090    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.175213 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.175130    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.675085963 +0000 UTC m=+255.227693667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.175213 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.175161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b65400e-ae1a-4a8c-a074-54e628e4acf8-data-volume\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.175383 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.175223    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.675202706 +0000 UTC m=+255.227810392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.182739 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.182709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfbh\" (UniqueName: \"kubernetes.io/projected/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-api-access-djfbh\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.276533 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.276455    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7"]
Sep 16 21:53:18.279265 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:18.279240    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e87bdec_f51b_4aa4_945c_d5de70e4b0a6.slice/crio-6c83032d2b717e669d02a3556c461458f5c3e936390a5be9b8b07978058487f2 WatchSource:0}: Error finding container 6c83032d2b717e669d02a3556c461458f5c3e936390a5be9b8b07978058487f2: Status 404 returned error can't find the container with id 6c83032d2b717e669d02a3556c461458f5c3e936390a5be9b8b07978058487f2
Sep 16 21:53:18.678560 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.678525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.678738 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.678595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:18.678738 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.678657    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.678738 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.678689    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.678738 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.678722    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.67870763 +0000 UTC m=+256.231315325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.678738 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.678737    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.678730664 +0000 UTC m=+256.231338344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.692420 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.692386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7" event={"ID":"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6","Type":"ContainerStarted","Data":"6c83032d2b717e669d02a3556c461458f5c3e936390a5be9b8b07978058487f2"}
Sep 16 21:53:18.694138 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.694115    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/1.log"
Sep 16 21:53:18.694465 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:18.694452    2561 scope.go:117] "RemoveContainer" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"
Sep 16 21:53:18.694664 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:18.694617    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:19.686612 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:19.686548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:19.686797 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:19.686647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:19.686797 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:19.686693    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:19.686797 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:19.686766    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.686749011 +0000 UTC m=+258.239356715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:19.686797 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:19.686779    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:19.686937 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:19.686824    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.686808624 +0000 UTC m=+258.239416322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:19.699709 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:19.699678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7" event={"ID":"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6","Type":"ContainerStarted","Data":"e18a7b1adfccd0a329ab056d3465e4e667c934799ea1c47ae1e2355210a1571a"}
Sep 16 21:53:19.700060 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:19.699753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7" event={"ID":"7e87bdec-f51b-4aa4-945c-d5de70e4b0a6","Type":"ContainerStarted","Data":"22a88ed9bbc2a7a75b60c1d9cb5e22e4dbb945f32b7b3756056da0b3ad4018cf"}
Sep 16 21:53:19.714916 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:19.714757    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vnmw7" podStartSLOduration=1.7400116460000001 podStartE2EDuration="2.714738743s" totalImagesPullingTime="974.727097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:19.714267422 +0000 UTC m=+256.266875125" watchObservedRunningTime="2026-09-16 21:53:19.714738743 +0000 UTC m=+256.267346446"
Sep 16 21:53:20.898231 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:20.898187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:20.898231 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:20.898233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:20.898304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:20.898367    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:28.898344134 +0000 UTC m=+265.450951829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:20.898410    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:20.898409    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:20.898448    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls podName:71a82df3-a979-4a4a-8893-7600705138a4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:28.89843636 +0000 UTC m=+265.451044042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qd6cj" (UID: "71a82df3-a979-4a4a-8893-7600705138a4") : secret "samples-operator-tls" not found
Sep 16 21:53:20.898635 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:20.898523    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:28.898511739 +0000 UTC m=+265.451119421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : secret "router-metrics-certs-default" not found
Sep 16 21:53:21.002728 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:21.002703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zl58p_c0731d0a-d92c-4743-8649-109d1c45ae24/dns-node-resolver/0.log"
Sep 16 21:53:21.603231 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:21.603207    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92dsx_d3345e2c-98f0-4e97-b46c-bf0d4bc503f0/node-ca/0.log"
Sep 16 21:53:21.704796 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:21.704760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:21.704982 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:21.704870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:21.704982 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:21.704878    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:21.704982 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:21.704936    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.70491752 +0000 UTC m=+262.257525217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:21.704982 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:21.704957    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:21.705153 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:21.704992    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.704980974 +0000 UTC m=+262.257588671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:22.603676 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:22.603651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2glq_42f360e7-fbf8-483b-8df4-27fc1b21fdc8/serve-healthcheck-canary/0.log"
Sep 16 21:53:23.004001 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:23.003925    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vnmw7_7e87bdec-f51b-4aa4-945c-d5de70e4b0a6/migrator/0.log"
Sep 16 21:53:23.211684 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:23.211655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vnmw7_7e87bdec-f51b-4aa4-945c-d5de70e4b0a6/graceful-termination/0.log"
Sep 16 21:53:23.441689 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:23.441643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:23.441890 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:23.441720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:23.442127 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:23.442089    2561 scope.go:117] "RemoveContainer" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"
Sep 16 21:53:23.442325 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:23.442303    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:25.737433 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:25.737399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:25.737817 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:25.737487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:25.737817 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:25.737516    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:25.737817 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:25.737576    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.737560382 +0000 UTC m=+270.290168066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:25.737817 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:25.737582    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:25.737817 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:25.737621    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls podName:1b65400e-ae1a-4a8c-a074-54e628e4acf8 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.737609068 +0000 UTC m=+270.290216764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcd54" (UID: "1b65400e-ae1a-4a8c-a074-54e628e4acf8") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:28.965513 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:28.964535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:28.965513 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:28.964686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:28.965513 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:28.964721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:28.968471 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:28.968435    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle podName:24898bab-eb30-4e8c-ba37-ca86bfcfb56b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:44.968410369 +0000 UTC m=+281.521018055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle") pod "router-default-b5fb467cd-qxv9d" (UID: "24898bab-eb30-4e8c-ba37-ca86bfcfb56b") : configmap references non-existent config key: service-ca.crt
Sep 16 21:53:28.968870 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:28.968846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71a82df3-a979-4a4a-8893-7600705138a4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qd6cj\" (UID: \"71a82df3-a979-4a4a-8893-7600705138a4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:28.970333 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:28.970311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-metrics-certs\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:29.034551 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:29.034513    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"
Sep 16 21:53:29.301595 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:29.301564    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj"]
Sep 16 21:53:29.730626 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:29.730538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj" event={"ID":"71a82df3-a979-4a4a-8893-7600705138a4","Type":"ContainerStarted","Data":"4bb07f5d1b73f025ed08032847bcacfee3a121128a88b8665b5cc601a209f542"}
Sep 16 21:53:31.738454 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:31.738365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj" event={"ID":"71a82df3-a979-4a4a-8893-7600705138a4","Type":"ContainerStarted","Data":"f681f5eefe8d12ebfe433ec6d3269257e44974b01c610999c8cbfac4748a5f68"}
Sep 16 21:53:31.738454 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:31.738421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj" event={"ID":"71a82df3-a979-4a4a-8893-7600705138a4","Type":"ContainerStarted","Data":"6fb6677aba4a21db5132e87d214c0f05bf33e69a5bdc8b577d05b1adabf72a46"}
Sep 16 21:53:31.754752 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:31.754701    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qd6cj" podStartSLOduration=16.707666821 podStartE2EDuration="18.754681971s" totalImagesPullingTime="2.04701515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:31.753488852 +0000 UTC m=+268.306096557" watchObservedRunningTime="2026-09-16 21:53:31.754681971 +0000 UTC m=+268.307289674"
Sep 16 21:53:33.805260 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:33.805225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:33.805655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:33.805296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:33.805830 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:33.805808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b65400e-ae1a-4a8c-a074-54e628e4acf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:33.807565 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:33.807549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b65400e-ae1a-4a8c-a074-54e628e4acf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcd54\" (UID: \"1b65400e-ae1a-4a8c-a074-54e628e4acf8\") " pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:33.933220 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:33.933177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcd54"
Sep 16 21:53:34.204347 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:34.204273    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcd54"]
Sep 16 21:53:34.207415 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:34.207379    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b65400e_ae1a_4a8c_a074_54e628e4acf8.slice/crio-ccc4d090ac69b4dc8ab4d5ce715a8a718bd1a1dae4531d8deb87460001bc9533 WatchSource:0}: Error finding container ccc4d090ac69b4dc8ab4d5ce715a8a718bd1a1dae4531d8deb87460001bc9533: Status 404 returned error can't find the container with id ccc4d090ac69b4dc8ab4d5ce715a8a718bd1a1dae4531d8deb87460001bc9533
Sep 16 21:53:34.749432 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:34.749399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcd54" event={"ID":"1b65400e-ae1a-4a8c-a074-54e628e4acf8","Type":"ContainerStarted","Data":"0ec9fd1efa41b09365feede5b27a35848d5a3bd24d6b361974b1aff4e7907105"}
Sep 16 21:53:34.749585 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:34.749454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcd54" event={"ID":"1b65400e-ae1a-4a8c-a074-54e628e4acf8","Type":"ContainerStarted","Data":"ccc4d090ac69b4dc8ab4d5ce715a8a718bd1a1dae4531d8deb87460001bc9533"}
Sep 16 21:53:36.758765 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:36.758723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcd54" event={"ID":"1b65400e-ae1a-4a8c-a074-54e628e4acf8","Type":"ContainerStarted","Data":"bc826fa0a2ed575639df942354a49e2b8d1175bca071a785195fc211379df53b"}
Sep 16 21:53:37.763983 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:37.763947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcd54" event={"ID":"1b65400e-ae1a-4a8c-a074-54e628e4acf8","Type":"ContainerStarted","Data":"3b4f7f7626d2ece2c38ee8f8915b149af6d8f3e95ada8bfe6a396174a65e2e27"}
Sep 16 21:53:37.779797 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:37.779752    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qcd54" podStartSLOduration=17.839001472 podStartE2EDuration="20.779737545s" totalImagesPullingTime="2.940736073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:37.779074133 +0000 UTC m=+274.331681840" watchObservedRunningTime="2026-09-16 21:53:37.779737545 +0000 UTC m=+274.332345248"
Sep 16 21:53:38.919717 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:38.919691    2561 scope.go:117] "RemoveContainer" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"
Sep 16 21:53:39.771707 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.771676    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:53:39.772146 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.772130    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/1.log"
Sep 16 21:53:39.772232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.772163    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e48c365-2533-4f3f-992b-663445e65bd9" containerID="e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e" exitCode=255
Sep 16 21:53:39.772232 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.772221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" event={"ID":"6e48c365-2533-4f3f-992b-663445e65bd9","Type":"ContainerDied","Data":"e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e"}
Sep 16 21:53:39.772319 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.772291    2561 scope.go:117] "RemoveContainer" containerID="453dad6f8df7d7d204e787fd4edd6bab5d771c001cf1ab553679b8830c2845ab"
Sep 16 21:53:39.772582 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:39.772564    2561 scope.go:117] "RemoveContainer" containerID="e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e"
Sep 16 21:53:39.772752 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:39.772734    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:40.776488 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:40.776456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:53:43.441440 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:43.441394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:43.441868 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:43.441458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:53:43.441868 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:43.441769    2561 scope.go:117] "RemoveContainer" containerID="e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e"
Sep 16 21:53:43.441937 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:43.441905    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:44.446194 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:44.446150    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lsnmt" podUID="92df0d08-c192-4d3e-a313-3c45be57210e"
Sep 16 21:53:44.789519 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:44.789443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:53:44.991405 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:44.991375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:44.991934 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:44.991915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24898bab-eb30-4e8c-ba37-ca86bfcfb56b-service-ca-bundle\") pod \"router-default-b5fb467cd-qxv9d\" (UID: \"24898bab-eb30-4e8c-ba37-ca86bfcfb56b\") " pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:45.246259 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:45.246222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:45.514999 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:45.514924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b5fb467cd-qxv9d"]
Sep 16 21:53:45.518476 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:45.518446    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24898bab_eb30_4e8c_ba37_ca86bfcfb56b.slice/crio-25f0fac16346140f325a0d01ef8cea83e4e219fbfba36e1668f3d15a9c518d2e WatchSource:0}: Error finding container 25f0fac16346140f325a0d01ef8cea83e4e219fbfba36e1668f3d15a9c518d2e: Status 404 returned error can't find the container with id 25f0fac16346140f325a0d01ef8cea83e4e219fbfba36e1668f3d15a9c518d2e
Sep 16 21:53:45.793814 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:45.793784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b5fb467cd-qxv9d" event={"ID":"24898bab-eb30-4e8c-ba37-ca86bfcfb56b","Type":"ContainerStarted","Data":"8e10fa916036fb4c38ac970c3544ccb946cd1b53324f980b76f1ee31307922dc"}
Sep 16 21:53:45.793989 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:45.793835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b5fb467cd-qxv9d" event={"ID":"24898bab-eb30-4e8c-ba37-ca86bfcfb56b","Type":"ContainerStarted","Data":"25f0fac16346140f325a0d01ef8cea83e4e219fbfba36e1668f3d15a9c518d2e"}
Sep 16 21:53:45.810277 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:45.810231    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b5fb467cd-qxv9d" podStartSLOduration=32.810212218 podStartE2EDuration="32.810212218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:45.8093869 +0000 UTC m=+282.361994602" watchObservedRunningTime="2026-09-16 21:53:45.810212218 +0000 UTC m=+282.362819921"
Sep 16 21:53:46.247474 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:46.247383    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:46.250043 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:46.250020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:46.797502 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:46.797477    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:46.798788 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:46.798770    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b5fb467cd-qxv9d"
Sep 16 21:53:47.423871 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.423836    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"]
Sep 16 21:53:47.426980 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.426964    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:47.428835 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.428818    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 16 21:53:47.428903 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.428891    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-55hdn\""
Sep 16 21:53:47.436774 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.436751    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"]
Sep 16 21:53:47.509734 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.509695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zw2lw\" (UID: \"02d7cd43-cf98-42e5-83cc-f826b2b206aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:47.610332 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.610302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zw2lw\" (UID: \"02d7cd43-cf98-42e5-83cc-f826b2b206aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:47.610495 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:47.610412    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 21:53:47.610495 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:47.610467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates podName:02d7cd43-cf98-42e5-83cc-f826b2b206aa nodeName:}" failed. No retries permitted until 2026-09-16 21:53:48.110452592 +0000 UTC m=+284.663060286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-zw2lw" (UID: "02d7cd43-cf98-42e5-83cc-f826b2b206aa") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 21:53:47.710804 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.710732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:53:47.712968 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.712951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92df0d08-c192-4d3e-a313-3c45be57210e-metrics-tls\") pod \"dns-default-lsnmt\" (UID: \"92df0d08-c192-4d3e-a313-3c45be57210e\") " pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:53:47.791663 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.791636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\""
Sep 16 21:53:47.799908 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:47.799888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:53:48.071524 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.071495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsnmt"]
Sep 16 21:53:48.074552 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:48.074518    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92df0d08_c192_4d3e_a313_3c45be57210e.slice/crio-8aad753f94e84f299735bbe6d5807532894e3b0dd3b22c9af5762c26d5528582 WatchSource:0}: Error finding container 8aad753f94e84f299735bbe6d5807532894e3b0dd3b22c9af5762c26d5528582: Status 404 returned error can't find the container with id 8aad753f94e84f299735bbe6d5807532894e3b0dd3b22c9af5762c26d5528582
Sep 16 21:53:48.113563 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.113537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zw2lw\" (UID: \"02d7cd43-cf98-42e5-83cc-f826b2b206aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:48.115911 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.115882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02d7cd43-cf98-42e5-83cc-f826b2b206aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zw2lw\" (UID: \"02d7cd43-cf98-42e5-83cc-f826b2b206aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:48.335464 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.335380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:48.605146 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.605062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"]
Sep 16 21:53:48.608345 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:48.608316    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d7cd43_cf98_42e5_83cc_f826b2b206aa.slice/crio-672b7304418008a2e1eafa45dd9e9238ae75d5d13de16d3b1043eb5a0c28eab7 WatchSource:0}: Error finding container 672b7304418008a2e1eafa45dd9e9238ae75d5d13de16d3b1043eb5a0c28eab7: Status 404 returned error can't find the container with id 672b7304418008a2e1eafa45dd9e9238ae75d5d13de16d3b1043eb5a0c28eab7
Sep 16 21:53:48.805862 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.805819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw" event={"ID":"02d7cd43-cf98-42e5-83cc-f826b2b206aa","Type":"ContainerStarted","Data":"672b7304418008a2e1eafa45dd9e9238ae75d5d13de16d3b1043eb5a0c28eab7"}
Sep 16 21:53:48.807263 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:48.807235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsnmt" event={"ID":"92df0d08-c192-4d3e-a313-3c45be57210e","Type":"ContainerStarted","Data":"8aad753f94e84f299735bbe6d5807532894e3b0dd3b22c9af5762c26d5528582"}
Sep 16 21:53:50.817989 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.817946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsnmt" event={"ID":"92df0d08-c192-4d3e-a313-3c45be57210e","Type":"ContainerStarted","Data":"bbdca8e023adb70d2124486a2e2b5b604bbaa344d9452812d5fa5a02d20c9329"}
Sep 16 21:53:50.818479 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.818010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsnmt" event={"ID":"92df0d08-c192-4d3e-a313-3c45be57210e","Type":"ContainerStarted","Data":"4aace7d1f84d51c6705755caeacf25d6c203ceb12c0b5ddeaf93984765a685ae"}
Sep 16 21:53:50.818479 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.818065    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:53:50.819454 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.819431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw" event={"ID":"02d7cd43-cf98-42e5-83cc-f826b2b206aa","Type":"ContainerStarted","Data":"98d9901d1e071ed408ccb4d21409bd358608d11ae5172ac2144f03733997b14f"}
Sep 16 21:53:50.819638 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.819619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:50.824399 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.824377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw"
Sep 16 21:53:50.833426 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.833390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lsnmt" podStartSLOduration=251.835252725 podStartE2EDuration="4m13.833375779s" totalImagesPullingTime="1.998123054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:50.832384634 +0000 UTC m=+287.384992337" watchObservedRunningTime="2026-09-16 21:53:50.833375779 +0000 UTC m=+287.385983481"
Sep 16 21:53:50.845712 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:50.845671    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zw2lw" podStartSLOduration=2.38499936 podStartE2EDuration="3.845656598s" totalImagesPullingTime="1.460657238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:50.844579952 +0000 UTC m=+287.397187662" watchObservedRunningTime="2026-09-16 21:53:50.845656598 +0000 UTC m=+287.398264301"
Sep 16 21:53:51.487296 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.487265    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"]
Sep 16 21:53:51.490471 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.490454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.492858 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.492834    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 21:53:51.492963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.492878    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 21:53:51.492963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.492947    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 16 21:53:51.493074 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.492973    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 21:53:51.493074 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.492979    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 16 21:53:51.493177 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.493166    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-228cr\""
Sep 16 21:53:51.502434 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.502413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"]
Sep 16 21:53:51.640674 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.640630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.640852 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.640693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.640852 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.640768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736791da-df14-4040-a6df-79b47f84d333-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.640852 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.640810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldtlt\" (UniqueName: \"kubernetes.io/projected/736791da-df14-4040-a6df-79b47f84d333-kube-api-access-ldtlt\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.742059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.741980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.742059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.742034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.742059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.742059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736791da-df14-4040-a6df-79b47f84d333-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.742283 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.742076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldtlt\" (UniqueName: \"kubernetes.io/projected/736791da-df14-4040-a6df-79b47f84d333-kube-api-access-ldtlt\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.742842 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.742818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736791da-df14-4040-a6df-79b47f84d333-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.744479 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.744452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.744564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.744454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/736791da-df14-4040-a6df-79b47f84d333-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.749073 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.749052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldtlt\" (UniqueName: \"kubernetes.io/projected/736791da-df14-4040-a6df-79b47f84d333-kube-api-access-ldtlt\") pod \"prometheus-operator-68bcd7f987-gbcsm\" (UID: \"736791da-df14-4040-a6df-79b47f84d333\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:51.798948 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:51.798922    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"
Sep 16 21:53:52.066438 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:52.066408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm"]
Sep 16 21:53:52.069301 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:52.069271    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736791da_df14_4040_a6df_79b47f84d333.slice/crio-cc83304f147f12a25025c58a729ffc98f732917b175a4ebb1a8eee11aaaf234d WatchSource:0}: Error finding container cc83304f147f12a25025c58a729ffc98f732917b175a4ebb1a8eee11aaaf234d: Status 404 returned error can't find the container with id cc83304f147f12a25025c58a729ffc98f732917b175a4ebb1a8eee11aaaf234d
Sep 16 21:53:52.826824 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:52.826787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm" event={"ID":"736791da-df14-4040-a6df-79b47f84d333","Type":"ContainerStarted","Data":"cc83304f147f12a25025c58a729ffc98f732917b175a4ebb1a8eee11aaaf234d"}
Sep 16 21:53:53.832991 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:53.832959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm" event={"ID":"736791da-df14-4040-a6df-79b47f84d333","Type":"ContainerStarted","Data":"c99ce4e89358a4801ddc92b51d91a638edd121cd47881aa1d8b8939ed6f22a78"}
Sep 16 21:53:53.833431 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:53.833035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm" event={"ID":"736791da-df14-4040-a6df-79b47f84d333","Type":"ContainerStarted","Data":"347f29252d0c0a591a14f2a5ea508133bbc522b4b076bc6eab68d80977148dd2"}
Sep 16 21:53:53.849157 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:53.849116    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gbcsm" podStartSLOduration=1.225451962 podStartE2EDuration="2.849088115s" totalImagesPullingTime="1.623636153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:53.847844918 +0000 UTC m=+290.400452623" watchObservedRunningTime="2026-09-16 21:53:53.849088115 +0000 UTC m=+290.401695818"
Sep 16 21:53:55.847929 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.847896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l9tbn"]
Sep 16 21:53:55.850942 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.850922    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.853537 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.853514    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 21:53:55.853732 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.853710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 21:53:55.854732 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.854716    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 21:53:55.854787 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.854719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lrmkc\""
Sep 16 21:53:55.977031 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.976992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-textfile\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977219 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977219 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-sys\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977219 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-tls\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977219 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-wtmp\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977353 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-accelerators-collector-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977353 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpg4\" (UniqueName: \"kubernetes.io/projected/0686c2bf-5877-4270-af8e-2f1a56d9cf74-kube-api-access-2cpg4\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977353 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-metrics-client-ca\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:55.977353 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:55.977309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-root\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078288 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-textfile\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078288 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-sys\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-tls\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-wtmp\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-accelerators-collector-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-sys\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpg4\" (UniqueName: \"kubernetes.io/projected/0686c2bf-5877-4270-af8e-2f1a56d9cf74-kube-api-access-2cpg4\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-metrics-client-ca\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078512 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-root\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-root\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078888 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-wtmp\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.078998 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.078955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-textfile\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.079144 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.079120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-accelerators-collector-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.079205 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.079127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0686c2bf-5877-4270-af8e-2f1a56d9cf74-metrics-client-ca\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.080696 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.080672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.081134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.081115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0686c2bf-5877-4270-af8e-2f1a56d9cf74-node-exporter-tls\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.085652 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.085625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpg4\" (UniqueName: \"kubernetes.io/projected/0686c2bf-5877-4270-af8e-2f1a56d9cf74-kube-api-access-2cpg4\") pod \"node-exporter-l9tbn\" (UID: \"0686c2bf-5877-4270-af8e-2f1a56d9cf74\") " pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.160024 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.159947    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l9tbn"
Sep 16 21:53:56.171053 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:56.171027    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0686c2bf_5877_4270_af8e_2f1a56d9cf74.slice/crio-e594b3a04daae98c07d37f9ef6e8a5cbb22c61b65082688818ad669a468685a0 WatchSource:0}: Error finding container e594b3a04daae98c07d37f9ef6e8a5cbb22c61b65082688818ad669a468685a0: Status 404 returned error can't find the container with id e594b3a04daae98c07d37f9ef6e8a5cbb22c61b65082688818ad669a468685a0
Sep 16 21:53:56.845221 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.845189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l9tbn" event={"ID":"0686c2bf-5877-4270-af8e-2f1a56d9cf74","Type":"ContainerStarted","Data":"e594b3a04daae98c07d37f9ef6e8a5cbb22c61b65082688818ad669a468685a0"}
Sep 16 21:53:56.909342 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.909308    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:53:56.914177 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.914152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:56.916083 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 21:53:56.916225 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916062    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 21:53:56.916722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916486    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfx8s\""
Sep 16 21:53:56.916722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916498    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 21:53:56.916722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916561    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 21:53:56.916722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916577    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 21:53:56.916722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 21:53:56.917059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 21:53:56.917059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916902    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 21:53:56.917059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.916904    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 21:53:56.928980 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:56.928953    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:53:57.085813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.085778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.085813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.085820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086064 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.085847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086064 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.085874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086064 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.085975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086064 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086064 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68x6g\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.086352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.086283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187463 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187463 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68x6g\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187463 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187618 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187618 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187618 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187760 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187760 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:57.187646    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 16 21:53:57.187760 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:57.187706    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls podName:e44ba162-541d-421f-83fa-c435d6ab784c nodeName:}" failed. No retries permitted until 2026-09-16 21:53:57.687686452 +0000 UTC m=+294.240294136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c") : secret "alertmanager-main-tls" not found
Sep 16 21:53:57.187760 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187961 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187961 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.187961 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.187861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.188589 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.188415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.188589 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.188426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.188986 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.188962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.190615 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.190569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.191290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.190886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.191290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.191133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.191290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.191167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.191478 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.191297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.192004 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.191979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.192115 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.192014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.192115 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.192026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.197144 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.197121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68x6g\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.692944 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.692907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.695307 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.695280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.826565 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.826522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:53:57.850402 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.850367    2561 generic.go:356] "Generic (PLEG): container finished" podID="0686c2bf-5877-4270-af8e-2f1a56d9cf74" containerID="633345aed79cf160d7b4f17705b000779e8f60f58bcec01f421b8e44b271d701" exitCode=0
Sep 16 21:53:57.850553 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:57.850447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l9tbn" event={"ID":"0686c2bf-5877-4270-af8e-2f1a56d9cf74","Type":"ContainerDied","Data":"633345aed79cf160d7b4f17705b000779e8f60f58bcec01f421b8e44b271d701"}
Sep 16 21:53:58.104791 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.104769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:53:58.106963 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:53:58.106936    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44ba162_541d_421f_83fa_c435d6ab784c.slice/crio-3308666fe87bb9867c50eb9a0aa4544bb71830bfa65b19aee593d2ded4c43099 WatchSource:0}: Error finding container 3308666fe87bb9867c50eb9a0aa4544bb71830bfa65b19aee593d2ded4c43099: Status 404 returned error can't find the container with id 3308666fe87bb9867c50eb9a0aa4544bb71830bfa65b19aee593d2ded4c43099
Sep 16 21:53:58.855814 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.855775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"3308666fe87bb9867c50eb9a0aa4544bb71830bfa65b19aee593d2ded4c43099"}
Sep 16 21:53:58.858467 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.858410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l9tbn" event={"ID":"0686c2bf-5877-4270-af8e-2f1a56d9cf74","Type":"ContainerStarted","Data":"048e937e6d861ee1a24696490b7793b2bc55fec1e81d2319444dd4f29ec0bd95"}
Sep 16 21:53:58.858467 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.858462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l9tbn" event={"ID":"0686c2bf-5877-4270-af8e-2f1a56d9cf74","Type":"ContainerStarted","Data":"89a386d2ec873a32cb0b4a258cccf4909d7c09aeaea3e7d999341066755ca74c"}
Sep 16 21:53:58.880963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.880908    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l9tbn" podStartSLOduration=2.719131743 podStartE2EDuration="3.880893796s" totalImagesPullingTime="1.101245825s" totalInitContainerRuntime="60.516228ms" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:58.879894797 +0000 UTC m=+295.432502501" watchObservedRunningTime="2026-09-16 21:53:58.880893796 +0000 UTC m=+295.433501516"
Sep 16 21:53:58.919608 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:58.919576    2561 scope.go:117] "RemoveContainer" containerID="e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e"
Sep 16 21:53:58.919806 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:58.919782    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nl2qg_openshift-console-operator(6e48c365-2533-4f3f-992b-663445e65bd9)\"" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podUID="6e48c365-2533-4f3f-992b-663445e65bd9"
Sep 16 21:53:58.920943 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:53:58.920907    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cggth" podUID="0d183d5e-2171-44ed-b326-0d80cc7897db"
Sep 16 21:53:59.863144 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:59.863092    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a" exitCode=0
Sep 16 21:53:59.863601 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:53:59.863196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"}
Sep 16 21:54:00.617825 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.617781    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"]
Sep 16 21:54:00.624418 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.624391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:00.626264 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.626242    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hxd7x\""
Sep 16 21:54:00.626991 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.626966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"]
Sep 16 21:54:00.627201 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.627179    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 21:54:00.719079 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.719044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:00.719276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.719083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bds7s\" (UniqueName: \"kubernetes.io/projected/5a59974b-2f45-47a4-8803-7c276833507a-kube-api-access-bds7s\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:00.820407 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.820373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:00.820407 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.820409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bds7s\" (UniqueName: \"kubernetes.io/projected/5a59974b-2f45-47a4-8803-7c276833507a-kube-api-access-bds7s\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:00.820626 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:54:00.820526    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 21:54:00.820626 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:54:00.820594    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert podName:5a59974b-2f45-47a4-8803-7c276833507a nodeName:}" failed. No retries permitted until 2026-09-16 21:54:01.320572542 +0000 UTC m=+297.873180245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-zmp2s" (UID: "5a59974b-2f45-47a4-8803-7c276833507a") : secret "monitoring-plugin-cert" not found
Sep 16 21:54:00.824823 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.824798    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lsnmt"
Sep 16 21:54:00.828761 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:00.828741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bds7s\" (UniqueName: \"kubernetes.io/projected/5a59974b-2f45-47a4-8803-7c276833507a-kube-api-access-bds7s\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:01.325216 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.325176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:01.327822 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.327789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a59974b-2f45-47a4-8803-7c276833507a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zmp2s\" (UID: \"5a59974b-2f45-47a4-8803-7c276833507a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:01.538083 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.538057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:01.812308 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.812271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"]
Sep 16 21:54:01.816031 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:54:01.816004    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a59974b_2f45_47a4_8803_7c276833507a.slice/crio-fef2d36e64794d5561bf9758caa71985eb5894074c7cf2f0218c3b7bc8fc53d6 WatchSource:0}: Error finding container fef2d36e64794d5561bf9758caa71985eb5894074c7cf2f0218c3b7bc8fc53d6: Status 404 returned error can't find the container with id fef2d36e64794d5561bf9758caa71985eb5894074c7cf2f0218c3b7bc8fc53d6
Sep 16 21:54:01.875081 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.874989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"}
Sep 16 21:54:01.875081 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.875066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"}
Sep 16 21:54:01.875316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.875144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"}
Sep 16 21:54:01.875316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.875182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"}
Sep 16 21:54:01.875316 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.875208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"}
Sep 16 21:54:01.876320 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:01.876293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s" event={"ID":"5a59974b-2f45-47a4-8803-7c276833507a","Type":"ContainerStarted","Data":"fef2d36e64794d5561bf9758caa71985eb5894074c7cf2f0218c3b7bc8fc53d6"}
Sep 16 21:54:02.008496 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.008460    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:54:02.012971 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.012946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.015540 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.015508    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 21:54:02.015666 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.015612    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 21:54:02.015944 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.015909    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fvlv8vpis1t5r\""
Sep 16 21:54:02.016380 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016358    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 21:54:02.016569 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 21:54:02.016655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016635    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 21:54:02.016783 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016583    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 21:54:02.016896 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016878    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 21:54:02.017000 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.016825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 21:54:02.017127 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.017086    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 21:54:02.017253 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.017041    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 21:54:02.017530 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.017515    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 21:54:02.017777 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.017762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bjvgc\""
Sep 16 21:54:02.018169 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.018146    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 21:54:02.018465 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.018447    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 21:54:02.018748 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.018731    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 21:54:02.019177 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.019150    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 21:54:02.028500 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.028476    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwnq\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.031840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.032635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.032635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.032635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.032635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.031998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.032635 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.032043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.132885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.132885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.132885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwnq\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.132885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.132987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133229 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.133813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.133722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.134461 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.134432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.134584 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.134474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.135067 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.135037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.135710 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.135684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.136177 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.136151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.136255 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.136155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.136765 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.136697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.136765 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.136725    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.137587 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.137422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.137587 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.137496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.137845 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.137818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.138300 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.138275    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.138939 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.138916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.139418 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.139390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.139580 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.139559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.139663 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.139646    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.140482 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.140457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.141482 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.141463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwnq\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq\") pod \"prometheus-k8s-0\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.326352 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.326314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:02.610790 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.610754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:54:02.614553 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:54:02.614523    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9a4847_aeaf_4dbe_ae0e_1f22fc951900.slice/crio-4d2189cd9c0acd76c84590ef8f8fb66b2662c923c70f557590fe2db90f5607f9 WatchSource:0}: Error finding container 4d2189cd9c0acd76c84590ef8f8fb66b2662c923c70f557590fe2db90f5607f9: Status 404 returned error can't find the container with id 4d2189cd9c0acd76c84590ef8f8fb66b2662c923c70f557590fe2db90f5607f9
Sep 16 21:54:02.883309 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.883214    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e" exitCode=0
Sep 16 21:54:02.883309 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.883274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"}
Sep 16 21:54:02.883532 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:02.883351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"4d2189cd9c0acd76c84590ef8f8fb66b2662c923c70f557590fe2db90f5607f9"}
Sep 16 21:54:03.848562 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.848526    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:54:03.849785 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.849752    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:54:03.862591 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.862571    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:54:03.862910 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.862889    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:54:03.868134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.867986    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 21:54:03.901145 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.893519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerStarted","Data":"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"}
Sep 16 21:54:03.901145 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.895613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s" event={"ID":"5a59974b-2f45-47a4-8803-7c276833507a","Type":"ContainerStarted","Data":"0138a1f4863e51fc3b6869c8733d2ef4d0acb06b384caf8a3dfa75ea6f86c165"}
Sep 16 21:54:03.901145 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.895813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:03.902026 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.902003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s"
Sep 16 21:54:03.921521 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.921469    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.488036153 podStartE2EDuration="7.921451463s" totalImagesPullingTime="4.418405721s" totalInitContainerRuntime="15.009589ms" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:03.920075347 +0000 UTC m=+300.472683052" watchObservedRunningTime="2026-09-16 21:54:03.921451463 +0000 UTC m=+300.474059171"
Sep 16 21:54:03.937298 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:03.937236    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zmp2s" podStartSLOduration=2.362473984 podStartE2EDuration="3.937213284s" totalImagesPullingTime="1.5747393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:03.937209333 +0000 UTC m=+300.489817039" watchObservedRunningTime="2026-09-16 21:54:03.937213284 +0000 UTC m=+300.489820989"
Sep 16 21:54:06.599002 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:06.598977    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:54:06.912715 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:06.912678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"}
Sep 16 21:54:06.912895 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:06.912786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"}
Sep 16 21:54:08.925170 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:08.925137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"}
Sep 16 21:54:08.925549 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:08.925213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"}
Sep 16 21:54:09.931758 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:09.931724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"}
Sep 16 21:54:09.932164 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:09.931783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerStarted","Data":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"}
Sep 16 21:54:09.958186 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:09.958142    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.195200348 podStartE2EDuration="8.958126117s" totalImagesPullingTime="5.737498488s" totalInitContainerRuntime="25.427281ms" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:09.955794749 +0000 UTC m=+306.508402452" watchObservedRunningTime="2026-09-16 21:54:09.958126117 +0000 UTC m=+306.510733819"
Sep 16 21:54:10.919760 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:10.919729    2561 scope.go:117] "RemoveContainer" containerID="e524ba263d4350dcce217f08e2da96482fa459c3911b7b69067a83530460994e"
Sep 16 21:54:11.942297 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:11.942272    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:54:11.942701 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:11.942357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" event={"ID":"6e48c365-2533-4f3f-992b-663445e65bd9","Type":"ContainerStarted","Data":"21fa6ab3bcf5b7680a4eba6fb874cf9a8c8e4aba03a0c1ed701d507716e1a94d"}
Sep 16 21:54:11.942701 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:11.942630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:54:11.947660 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:11.947630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg"
Sep 16 21:54:11.957437 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:11.957384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-nl2qg" podStartSLOduration=56.449920093 podStartE2EDuration="58.957365313s" totalImagesPullingTime="2.50744522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:11.956598473 +0000 UTC m=+308.509206178" watchObservedRunningTime="2026-09-16 21:54:11.957365313 +0000 UTC m=+308.509973018"
Sep 16 21:54:12.326897 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:12.326860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:54:13.922821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:13.922788    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:54:42.052614 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.052583    2561 generic.go:356] "Generic (PLEG): container finished" podID="68f68988-945c-499f-bfe8-cff969e494a4" containerID="29e463676d12f36530a503861c21cee94f8dea16397ce71479ec0a7e695b754c" exitCode=0
Sep 16 21:54:42.053016 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.052668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-d9xq5" event={"ID":"68f68988-945c-499f-bfe8-cff969e494a4","Type":"ContainerDied","Data":"29e463676d12f36530a503861c21cee94f8dea16397ce71479ec0a7e695b754c"}
Sep 16 21:54:42.053016 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.053000    2561 scope.go:117] "RemoveContainer" containerID="29e463676d12f36530a503861c21cee94f8dea16397ce71479ec0a7e695b754c"
Sep 16 21:54:42.674948 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.674925    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/init-config-reloader/0.log"
Sep 16 21:54:42.684081 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.684053    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/alertmanager/0.log"
Sep 16 21:54:42.762551 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.762522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/config-reloader/0.log"
Sep 16 21:54:42.971351 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:42.971228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/kube-rbac-proxy-web/0.log"
Sep 16 21:54:43.059226 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:43.059192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-d9xq5" event={"ID":"68f68988-945c-499f-bfe8-cff969e494a4","Type":"ContainerStarted","Data":"8eb24e19613b447d6a9552d368402129064102546c1e83dddf8ec4087fd7c00a"}
Sep 16 21:54:43.161554 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:43.161531    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/kube-rbac-proxy/0.log"
Sep 16 21:54:43.363856 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:43.363828    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/kube-rbac-proxy-metric/0.log"
Sep 16 21:54:43.565538 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:43.565513    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e44ba162-541d-421f-83fa-c435d6ab784c/prom-label-proxy/0.log"
Sep 16 21:54:44.761580 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:44.761554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-zmp2s_5a59974b-2f45-47a4-8803-7c276833507a/monitoring-plugin/0.log"
Sep 16 21:54:45.563151 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:45.563125    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/init-textfile/0.log"
Sep 16 21:54:45.762967 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:45.762932    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/node-exporter/0.log"
Sep 16 21:54:45.963290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:45.963209    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/kube-rbac-proxy/0.log"
Sep 16 21:54:47.362917 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:47.362889    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/init-config-reloader/0.log"
Sep 16 21:54:47.562513 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:47.562481    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/prometheus/0.log"
Sep 16 21:54:47.762958 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:47.762883    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/config-reloader/0.log"
Sep 16 21:54:47.962794 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:47.962769    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/thanos-sidecar/0.log"
Sep 16 21:54:48.163072 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:48.163047    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/kube-rbac-proxy-web/0.log"
Sep 16 21:54:48.362464 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:48.362435    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/kube-rbac-proxy/0.log"
Sep 16 21:54:48.561528 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:48.561503    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/kube-rbac-proxy-thanos/0.log"
Sep 16 21:54:48.765247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:48.765216    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gbcsm_736791da-df14-4040-a6df-79b47f84d333/prometheus-operator/0.log"
Sep 16 21:54:48.961953 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:48.961879    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gbcsm_736791da-df14-4040-a6df-79b47f84d333/kube-rbac-proxy/0.log"
Sep 16 21:54:49.163390 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:49.163365    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-zw2lw_02d7cd43-cf98-42e5-83cc-f826b2b206aa/prometheus-operator-admission-webhook/0.log"
Sep 16 21:54:51.362039 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:51.362011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:54:51.564469 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:54:51.564441    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/3.log"
Sep 16 21:55:02.327225 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:02.327126    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:02.342680 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:02.342654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:03.153447 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:03.153417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:16.208471 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208439    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208809    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="alertmanager" containerID="cri-o://94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163" gracePeriod=120
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208856    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-metric" containerID="cri-o://b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2" gracePeriod=120
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208879    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="prom-label-proxy" containerID="cri-o://3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932" gracePeriod=120
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208918    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy" containerID="cri-o://200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d" gracePeriod=120
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208919    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-web" containerID="cri-o://2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c" gracePeriod=120
Sep 16 21:55:16.209075 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:16.208945    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="config-reloader" containerID="cri-o://3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e" gracePeriod=120
Sep 16 21:55:17.202383 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202350    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932" exitCode=0
Sep 16 21:55:17.202383 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202375    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d" exitCode=0
Sep 16 21:55:17.202383 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202382    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e" exitCode=0
Sep 16 21:55:17.202383 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202387    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163" exitCode=0
Sep 16 21:55:17.202655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"}
Sep 16 21:55:17.202655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"}
Sep 16 21:55:17.202655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"}
Sep 16 21:55:17.202655 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.202557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"}
Sep 16 21:55:17.463188 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.463136    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:55:17.589029 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.588991    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589029 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589059    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589092    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589140    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589160    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589191    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589221    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68x6g\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589262    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589649 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589321    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589649 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589649 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config\") pod \"e44ba162-541d-421f-83fa-c435d6ab784c\" (UID: \"e44ba162-541d-421f-83fa-c435d6ab784c\") "
Sep 16 21:55:17.589649 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:55:17.589874 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589705    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-main-db\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.589874 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.589621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:17.590068 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.590047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:17.592551 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.592551 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592537    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.592705 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.592705 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:55:17.592846 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592825    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out" (OuterVolumeSpecName: "config-out") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:55:17.592904 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.592883    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume" (OuterVolumeSpecName: "config-volume") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.593258 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.593231    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g" (OuterVolumeSpecName: "kube-api-access-68x6g") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "kube-api-access-68x6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:55:17.594261 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.594234    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.596708 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.596631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.602490 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.602469    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config" (OuterVolumeSpecName: "web-config") pod "e44ba162-541d-421f-83fa-c435d6ab784c" (UID: "e44ba162-541d-421f-83fa-c435d6ab784c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:17.691032 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.690982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691089    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-config-volume\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691119    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-web-config\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691129    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691138    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-cluster-tls-config\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691148    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691156    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-tls-assets\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691164    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-metrics-client-ca\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691172    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691181    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68x6g\" (UniqueName: \"kubernetes.io/projected/e44ba162-541d-421f-83fa-c435d6ab784c-kube-api-access-68x6g\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691189    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e44ba162-541d-421f-83fa-c435d6ab784c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691198    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e44ba162-541d-421f-83fa-c435d6ab784c-config-out\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.691514 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.691206    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44ba162-541d-421f-83fa-c435d6ab784c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:17.693131 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.693096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d183d5e-2171-44ed-b326-0d80cc7897db-metrics-certs\") pod \"network-metrics-daemon-cggth\" (UID: \"0d183d5e-2171-44ed-b326-0d80cc7897db\") " pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:55:17.826019 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.825993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\""
Sep 16 21:55:17.834592 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:17.834565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cggth"
Sep 16 21:55:18.116577 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.116490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cggth"]
Sep 16 21:55:18.120480 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:55:18.120449    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d183d5e_2171_44ed_b326_0d80cc7897db.slice/crio-f36c938ca0ddd738414755dc047e62ff97206ed33fcdd4a504422a452355a462 WatchSource:0}: Error finding container f36c938ca0ddd738414755dc047e62ff97206ed33fcdd4a504422a452355a462: Status 404 returned error can't find the container with id f36c938ca0ddd738414755dc047e62ff97206ed33fcdd4a504422a452355a462
Sep 16 21:55:18.209045 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209010    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2" exitCode=0
Sep 16 21:55:18.209045 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209038    2561 generic.go:356] "Generic (PLEG): container finished" podID="e44ba162-541d-421f-83fa-c435d6ab784c" containerID="2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c" exitCode=0
Sep 16 21:55:18.209304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209089    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 21:55:18.209304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"}
Sep 16 21:55:18.209304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"}
Sep 16 21:55:18.209304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209228    2561 scope.go:117] "RemoveContainer" containerID="3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"
Sep 16 21:55:18.209304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.209252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e44ba162-541d-421f-83fa-c435d6ab784c","Type":"ContainerDied","Data":"3308666fe87bb9867c50eb9a0aa4544bb71830bfa65b19aee593d2ded4c43099"}
Sep 16 21:55:18.210483 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.210466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cggth" event={"ID":"0d183d5e-2171-44ed-b326-0d80cc7897db","Type":"ContainerStarted","Data":"f36c938ca0ddd738414755dc047e62ff97206ed33fcdd4a504422a452355a462"}
Sep 16 21:55:18.217258 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.217230    2561 scope.go:117] "RemoveContainer" containerID="b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"
Sep 16 21:55:18.223878 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.223863    2561 scope.go:117] "RemoveContainer" containerID="200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"
Sep 16 21:55:18.230523 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.230509    2561 scope.go:117] "RemoveContainer" containerID="2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"
Sep 16 21:55:18.236762 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.236746    2561 scope.go:117] "RemoveContainer" containerID="3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"
Sep 16 21:55:18.241194 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.241173    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:55:18.243945 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.243929    2561 scope.go:117] "RemoveContainer" containerID="94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"
Sep 16 21:55:18.252872 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.252848    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 21:55:18.253427 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.253413    2561 scope.go:117] "RemoveContainer" containerID="82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"
Sep 16 21:55:18.260265 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.260251    2561 scope.go:117] "RemoveContainer" containerID="3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"
Sep 16 21:55:18.260521 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.260502    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932\": container with ID starting with 3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932 not found: ID does not exist" containerID="3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"
Sep 16 21:55:18.260573 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.260526    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"} err="failed to get container status \"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932\": rpc error: code = NotFound desc = could not find container \"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932\": container with ID starting with 3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932 not found: ID does not exist"
Sep 16 21:55:18.260573 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.260559    2561 scope.go:117] "RemoveContainer" containerID="b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"
Sep 16 21:55:18.260789 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.260771    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2\": container with ID starting with b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2 not found: ID does not exist" containerID="b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"
Sep 16 21:55:18.260850 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.260806    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"} err="failed to get container status \"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2\": rpc error: code = NotFound desc = could not find container \"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2\": container with ID starting with b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2 not found: ID does not exist"
Sep 16 21:55:18.260850 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.260828    2561 scope.go:117] "RemoveContainer" containerID="200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"
Sep 16 21:55:18.261120 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.261084    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d\": container with ID starting with 200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d not found: ID does not exist" containerID="200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"
Sep 16 21:55:18.261157 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261125    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"} err="failed to get container status \"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d\": rpc error: code = NotFound desc = could not find container \"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d\": container with ID starting with 200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d not found: ID does not exist"
Sep 16 21:55:18.261157 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261140    2561 scope.go:117] "RemoveContainer" containerID="2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"
Sep 16 21:55:18.261343 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.261327    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c\": container with ID starting with 2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c not found: ID does not exist" containerID="2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"
Sep 16 21:55:18.261407 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261359    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"} err="failed to get container status \"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c\": rpc error: code = NotFound desc = could not find container \"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c\": container with ID starting with 2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c not found: ID does not exist"
Sep 16 21:55:18.261407 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261379    2561 scope.go:117] "RemoveContainer" containerID="3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"
Sep 16 21:55:18.261631 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.261615    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e\": container with ID starting with 3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e not found: ID does not exist" containerID="3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"
Sep 16 21:55:18.261673 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261635    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"} err="failed to get container status \"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e\": rpc error: code = NotFound desc = could not find container \"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e\": container with ID starting with 3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e not found: ID does not exist"
Sep 16 21:55:18.261673 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261648    2561 scope.go:117] "RemoveContainer" containerID="94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"
Sep 16 21:55:18.261904 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.261889    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163\": container with ID starting with 94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163 not found: ID does not exist" containerID="94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"
Sep 16 21:55:18.261949 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261908    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"} err="failed to get container status \"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163\": rpc error: code = NotFound desc = could not find container \"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163\": container with ID starting with 94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163 not found: ID does not exist"
Sep 16 21:55:18.261949 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.261921    2561 scope.go:117] "RemoveContainer" containerID="82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"
Sep 16 21:55:18.262164 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:18.262147    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a\": container with ID starting with 82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a not found: ID does not exist" containerID="82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"
Sep 16 21:55:18.262215 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262170    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"} err="failed to get container status \"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a\": rpc error: code = NotFound desc = could not find container \"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a\": container with ID starting with 82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a not found: ID does not exist"
Sep 16 21:55:18.262215 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262185    2561 scope.go:117] "RemoveContainer" containerID="3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"
Sep 16 21:55:18.262413 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262392    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932"} err="failed to get container status \"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932\": rpc error: code = NotFound desc = could not find container \"3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932\": container with ID starting with 3fb6e86dee05ae33a2b8349c9878af09e0c7945eee2accde73fd92c13bc7d932 not found: ID does not exist"
Sep 16 21:55:18.262457 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262415    2561 scope.go:117] "RemoveContainer" containerID="b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"
Sep 16 21:55:18.262620 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262600    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2"} err="failed to get container status \"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2\": rpc error: code = NotFound desc = could not find container \"b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2\": container with ID starting with b573aa9343ec2bee93a269a4c51d61ad885bbcc2b610a3c9ffbd33d2877a4dd2 not found: ID does not exist"
Sep 16 21:55:18.262659 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262622    2561 scope.go:117] "RemoveContainer" containerID="200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"
Sep 16 21:55:18.262885 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262868    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d"} err="failed to get container status \"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d\": rpc error: code = NotFound desc = could not find container \"200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d\": container with ID starting with 200ad08366762988d71274e375260cf3e6e284019f55dbff9fdb0b40c820175d not found: ID does not exist"
Sep 16 21:55:18.262936 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.262885    2561 scope.go:117] "RemoveContainer" containerID="2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"
Sep 16 21:55:18.263144 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263123    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c"} err="failed to get container status \"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c\": rpc error: code = NotFound desc = could not find container \"2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c\": container with ID starting with 2c209b0bd120a70b0657df14017da9e12ee0a83e886dc60260e2668e465c223c not found: ID does not exist"
Sep 16 21:55:18.263200 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263144    2561 scope.go:117] "RemoveContainer" containerID="3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"
Sep 16 21:55:18.263373 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263356    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e"} err="failed to get container status \"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e\": rpc error: code = NotFound desc = could not find container \"3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e\": container with ID starting with 3bc32392911f16e238d2152e179871455bc81cef1fbd051a9da8dc42c9aaa65e not found: ID does not exist"
Sep 16 21:55:18.263418 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263373    2561 scope.go:117] "RemoveContainer" containerID="94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"
Sep 16 21:55:18.263602 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263585    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163"} err="failed to get container status \"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163\": rpc error: code = NotFound desc = could not find container \"94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163\": container with ID starting with 94893ae13887c4fc0121f6c1f66a3f5d00c742f36157fb1dd896a7aa32b11163 not found: ID does not exist"
Sep 16 21:55:18.263651 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263602    2561 scope.go:117] "RemoveContainer" containerID="82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"
Sep 16 21:55:18.263824 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:18.263808    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a"} err="failed to get container status \"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a\": rpc error: code = NotFound desc = could not find container \"82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a\": container with ID starting with 82384bdb1f58b3782c7d577d1cba29e00f091ce1307ec20980dd5c5b15c7a50a not found: ID does not exist"
Sep 16 21:55:19.228059 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:19.228026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cggth" event={"ID":"0d183d5e-2171-44ed-b326-0d80cc7897db","Type":"ContainerStarted","Data":"4e7093c861a280921697211df9830cfe811fc744fd614fbe5460e2b5daef65b3"}
Sep 16 21:55:19.924354 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:19.924322    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" path="/var/lib/kubelet/pods/e44ba162-541d-421f-83fa-c435d6ab784c/volumes"
Sep 16 21:55:20.234309 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.234216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cggth" event={"ID":"0d183d5e-2171-44ed-b326-0d80cc7897db","Type":"ContainerStarted","Data":"ec4186d05786d1521e8f166049aa93cb6a928c50dd24c994188f8a0c42bc9949"}
Sep 16 21:55:20.250871 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.250826    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cggth" podStartSLOduration=375.283950604 podStartE2EDuration="6m16.250813031s" totalImagesPullingTime="966.862427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:20.250009859 +0000 UTC m=+376.802617563" watchObservedRunningTime="2026-09-16 21:55:20.250813031 +0000 UTC m=+376.803420733"
Sep 16 21:55:20.493384 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.493296    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:20.493983 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.493946    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="prometheus" containerID="cri-o://bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed" gracePeriod=600
Sep 16 21:55:20.494557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.494159    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811" gracePeriod=600
Sep 16 21:55:20.494807 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.494259    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy" containerID="cri-o://16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985" gracePeriod=600
Sep 16 21:55:20.495489 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.494280    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-web" containerID="cri-o://7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056" gracePeriod=600
Sep 16 21:55:20.495489 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.494296    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="thanos-sidecar" containerID="cri-o://4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca" gracePeriod=600
Sep 16 21:55:20.495489 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.494313    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="config-reloader" containerID="cri-o://11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979" gracePeriod=600
Sep 16 21:55:20.737993 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.737966    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:20.826001 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.825969    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spwnq\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826041    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826068    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826196 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826174    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826203    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826227    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826282    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826372    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826488    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.826531 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826527    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.827142 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.827142 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.826591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls\") pod \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\" (UID: \"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900\") "
Sep 16 21:55:20.827427 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.827389    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.828745 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.828323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.828745 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.828475    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.828745 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.828603    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.829134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.829068    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:55:20.829518 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.829490    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.829896 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.829871    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.830130 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.830077    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:55:20.830509 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.830480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.830823 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.830742    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.831183 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.831146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.831613 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.831597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq" (OuterVolumeSpecName: "kube-api-access-spwnq") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "kube-api-access-spwnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:55:20.831724 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.831699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out" (OuterVolumeSpecName: "config-out") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:55:20.832018 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.831992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:55:20.832200 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.832025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.832200 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.832071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.832329 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.832241    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config" (OuterVolumeSpecName: "config") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.832822 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.832797    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.833580 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.833557    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.840784 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.840761    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config" (OuterVolumeSpecName: "web-config") pod "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" (UID: "3b9a4847-aeaf-4dbe-ae0e-1f22fc951900"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:55:20.927588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927549    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927581    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927588 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927592    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-metrics-client-ca\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927601    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-tls-assets\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927612    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-grpc-tls\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927620    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927629    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927637    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927645    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927653    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spwnq\" (UniqueName: \"kubernetes.io/projected/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-kube-api-access-spwnq\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927661    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927670    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927679    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-config-out\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927687    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-web-config\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927694    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-metrics-client-certs\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927702    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927711    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927719    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-db\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927727    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:20.927821 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:20.927736    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900-secret-kube-rbac-proxy\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245807    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811" exitCode=0
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245833    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985" exitCode=0
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245841    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056" exitCode=0
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245847    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca" exitCode=0
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245852    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979" exitCode=0
Sep 16 21:55:21.245891 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245857    2561 generic.go:356] "Generic (PLEG): container finished" podID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed" exitCode=0
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.245930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246090    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246143    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"}
Sep 16 21:55:21.246557 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.246363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b9a4847-aeaf-4dbe-ae0e-1f22fc951900","Type":"ContainerDied","Data":"4d2189cd9c0acd76c84590ef8f8fb66b2662c923c70f557590fe2db90f5607f9"}
Sep 16 21:55:21.255393 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.255370    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.263076 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.263059    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.269921 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.269817    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:21.269992 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.269944    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.273789 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.273767    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:21.276721 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.276704    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.283159 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.283143    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.290674 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.290657    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.297535 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.297296    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.297634 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.297608    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.297705 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.297644    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.297705 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.297669    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.298147 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.298027    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.298147 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298058    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.298147 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298080    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.298520 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.298444    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.298520 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298474    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.298520 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298493    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.298983 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.298815    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.298983 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298842    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.298983 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.298860    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.299207 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299190    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:21.299262 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.299200    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.299262 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299229    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.299262 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299250    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.299543 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299528    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299545    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.299538    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299555    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="config-reloader"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299561    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="config-reloader"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299573    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="config-reloader"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299567    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.299596 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299586    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299578    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="config-reloader"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299650    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299662    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="init-config-reloader"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299687    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="init-config-reloader"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299699    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="prom-label-proxy"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299707    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="prom-label-proxy"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299721    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="prometheus"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299731    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="prometheus"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299740    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299747    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299760    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-thanos"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299768    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-thanos"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299778    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="alertmanager"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299785    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="alertmanager"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299793    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="init-config-reloader"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299801    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="init-config-reloader"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299813    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="thanos-sidecar"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299823    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="thanos-sidecar"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299833    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-metric"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299841    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-metric"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299849    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.299901 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299857    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299941    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="thanos-sidecar"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299953    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299962    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-metric"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: E0916 21:55:21.299961    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299994    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300011    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.299971    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="config-reloader"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300066    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300073    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-thanos"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300082    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy-web"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300092    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="kube-rbac-proxy"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300120    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="alertmanager"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300129    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="prom-label-proxy"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300139    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" containerName="prometheus"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300148    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44ba162-541d-421f-83fa-c435d6ab784c" containerName="config-reloader"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300303    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300328    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300604    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.300813 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300619    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300856    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.300879    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301194    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301216    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301483    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.301564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301500    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.301826 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301742    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.301826 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.301772    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.302030 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302011    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.302071 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302031    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.302297 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302279    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.302297 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302296    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.302535 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302516    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.302592 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302539    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.302892 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302873    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.302892 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.302891    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.303534 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.303211    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.303534 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.303236    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.303534 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.303508    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.303534 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.303524    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.304489 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.304470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.305840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.304718    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.305840 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.304749    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.305995 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.305872    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.305995 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.305893    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.306258 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306219    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.306258 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306245    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306602    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306625    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306923    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.306947    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307117    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 21:55:21.307198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 21:55:21.307722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307456    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 21:55:21.307722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307534    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 21:55:21.307722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 21:55:21.307722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307682    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 21:55:21.307722 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307690    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 21:55:21.307963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307735    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 21:55:21.307963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307926    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 21:55:21.307963 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.307978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 21:55:21.308204 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308305    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fvlv8vpis1t5r\""
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308659    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308682    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bjvgc\""
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308918    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.309134 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.308939    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.309647 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309205    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.309647 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309230    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.309647 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309483    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.309647 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309503    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.309964 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309772    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.309964 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.309798    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.310210 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310084    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.310210 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310135    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.310465 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310435    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.310465 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310463    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.310771 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310751    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.310771 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310772    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.311020 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.310990    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 21:55:21.311169 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311046    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.311169 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311073    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.311373 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311353    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.311538 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311374    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.311671 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311617    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.311671 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311644    2561 scope.go:117] "RemoveContainer" containerID="c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"
Sep 16 21:55:21.311913 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311889    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811"} err="failed to get container status \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": rpc error: code = NotFound desc = could not find container \"c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811\": container with ID starting with c24de4e41cc40506bbc6d8fc2193d34ccd870937d99ef99a6f188b41070ce811 not found: ID does not exist"
Sep 16 21:55:21.311913 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.311913    2561 scope.go:117] "RemoveContainer" containerID="16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"
Sep 16 21:55:21.312198 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312174    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985"} err="failed to get container status \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": rpc error: code = NotFound desc = could not find container \"16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985\": container with ID starting with 16a0069eca688d920f7f85ea677d0c7e83666655118f15cac408bc55eb3f9985 not found: ID does not exist"
Sep 16 21:55:21.312290 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312199    2561 scope.go:117] "RemoveContainer" containerID="7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"
Sep 16 21:55:21.312473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312450    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056"} err="failed to get container status \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": rpc error: code = NotFound desc = could not find container \"7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056\": container with ID starting with 7733b56efc63cff8fd1fa1838ea91ade8754eb4fc85640a81b7ca664c0777056 not found: ID does not exist"
Sep 16 21:55:21.312473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312470    2561 scope.go:117] "RemoveContainer" containerID="4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"
Sep 16 21:55:21.312740 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312719    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca"} err="failed to get container status \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": rpc error: code = NotFound desc = could not find container \"4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca\": container with ID starting with 4a80465741cdcf604cf321d90b4cbbe0491126280792e4949db7df8623eeaaca not found: ID does not exist"
Sep 16 21:55:21.312740 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312740    2561 scope.go:117] "RemoveContainer" containerID="11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"
Sep 16 21:55:21.313029 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.312992    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979"} err="failed to get container status \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": rpc error: code = NotFound desc = could not find container \"11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979\": container with ID starting with 11b8a62ef7b3444e6386b35fc4fbce9e3d8e022d30582f01562ced86d3781979 not found: ID does not exist"
Sep 16 21:55:21.313029 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.313017    2561 scope.go:117] "RemoveContainer" containerID="bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"
Sep 16 21:55:21.313328 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.313300    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 21:55:21.313486 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.313463    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed"} err="failed to get container status \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": rpc error: code = NotFound desc = could not find container \"bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed\": container with ID starting with bc5e650855d4f2fd0c932f3e22d2be1933965430f008adc3da6f25d40c7882ed not found: ID does not exist"
Sep 16 21:55:21.313552 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.313489    2561 scope.go:117] "RemoveContainer" containerID="5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"
Sep 16 21:55:21.313763 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.313743    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e"} err="failed to get container status \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": rpc error: code = NotFound desc = could not find container \"5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e\": container with ID starting with 5642ccef6c85352f1afddba0fcdb360d7727935ecff3e2763f2d41ccbd7d083e not found: ID does not exist"
Sep 16 21:55:21.322200 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.322177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:21.431623 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431623 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.431833 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjp6n\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-kube-api-access-xjp6n\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.431986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432005 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.432246 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.432168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.532918 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.532884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533058 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.532923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533058 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.532941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533178 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533178 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533280 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533370 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjp6n\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-kube-api-access-xjp6n\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.533769 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.533984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534276 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534608 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534764 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.534824 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.534805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.535111 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.535073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.536140 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.536079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.537451 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.537423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.537535 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.537426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.537535 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.537430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-config\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.537956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.537930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.538270 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.538249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4920543a-b19f-4346-94b9-32715350ab0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.538456 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.538428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.538790 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.538758    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.538900 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.538880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.539023 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.539002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4920543a-b19f-4346-94b9-32715350ab0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.539071 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.539040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4920543a-b19f-4346-94b9-32715350ab0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.539311 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.539291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.542505 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.542483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjp6n\" (UniqueName: \"kubernetes.io/projected/4920543a-b19f-4346-94b9-32715350ab0e-kube-api-access-xjp6n\") pod \"prometheus-k8s-0\" (UID: \"4920543a-b19f-4346-94b9-32715350ab0e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.617216 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.617177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:55:21.895473 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.895432    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 21:55:21.898426 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:55:21.898400    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4920543a_b19f_4346_94b9_32715350ab0e.slice/crio-830a37da771f57c5ce98374757fa4c6c065a3d328c3beef3ab62d5e5c0bdb8dc WatchSource:0}: Error finding container 830a37da771f57c5ce98374757fa4c6c065a3d328c3beef3ab62d5e5c0bdb8dc: Status 404 returned error can't find the container with id 830a37da771f57c5ce98374757fa4c6c065a3d328c3beef3ab62d5e5c0bdb8dc
Sep 16 21:55:21.924180 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:21.924154    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9a4847-aeaf-4dbe-ae0e-1f22fc951900" path="/var/lib/kubelet/pods/3b9a4847-aeaf-4dbe-ae0e-1f22fc951900/volumes"
Sep 16 21:55:22.252403 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:22.252309    2561 generic.go:356] "Generic (PLEG): container finished" podID="4920543a-b19f-4346-94b9-32715350ab0e" containerID="bdf6cfd248719112656b24a12432955db811e71e12a4d49ae5f715071f1bb6b5" exitCode=0
Sep 16 21:55:22.252403 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:22.252374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerDied","Data":"bdf6cfd248719112656b24a12432955db811e71e12a4d49ae5f715071f1bb6b5"}
Sep 16 21:55:22.252904 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:22.252428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"830a37da771f57c5ce98374757fa4c6c065a3d328c3beef3ab62d5e5c0bdb8dc"}
Sep 16 21:55:23.259638 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"cef6251b073d9d66a8c238f2df334fc497ecb5cdae2d205c8a9f06ae00a6bad9"}
Sep 16 21:55:23.259996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"cacfc76379e1f0fd2653e1d44ca129236c025dfa20fd050c2265c6f354e26f34"}
Sep 16 21:55:23.259996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"b1e340473817fb47f46dfb79a24f3f4d4cf9a7eec99410a9aa43519c0cc65700"}
Sep 16 21:55:23.259996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"2a67c2b8b478c007ab1b54a63467a1bbd94b66a67e33ef64fd6e47be721ba55c"}
Sep 16 21:55:23.259996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"8baa79b4baa7ee2d01fd90f2fb99326d4d3ec120814d99268dc6361eda7e8e45"}
Sep 16 21:55:23.259996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.259772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4920543a-b19f-4346-94b9-32715350ab0e","Type":"ContainerStarted","Data":"4020001aac8801ce3e39a8268424d2267326953ea793db93dbf0262500a645d0"}
Sep 16 21:55:23.291739 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:23.291678    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.276275391 podStartE2EDuration="2.291658358s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.382967ms" isStatefulPod=false podCreationTimestamp="2026-09-16 21:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:23.289334798 +0000 UTC m=+379.841942536" watchObservedRunningTime="2026-09-16 21:55:23.291658358 +0000 UTC m=+379.844266063"
Sep 16 21:55:26.617594 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:55:26.617551    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:56:21.617995 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:56:21.617957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:56:21.633091 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:56:21.633066    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:56:22.506284 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:56:22.506260    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 21:57:20.808782 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.808744    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"]
Sep 16 21:57:20.812078 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.812059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.814044 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.814007    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7ssw8\""
Sep 16 21:57:20.814221 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.814047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 21:57:20.814221 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.814089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 21:57:20.814340 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.814323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 21:57:20.814385 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.814366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 21:57:20.826952 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.826926    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"]
Sep 16 21:57:20.873708 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.873668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.873708 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.873709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.873956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.873749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcc5k\" (UniqueName: \"kubernetes.io/projected/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-kube-api-access-rcc5k\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.873956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.873789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.873956 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.873843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975173 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975363 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975363 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975363 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcc5k\" (UniqueName: \"kubernetes.io/projected/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-kube-api-access-rcc5k\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975363 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.975611 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.975588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.977522 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.977490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.977677 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.977658    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.977752 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.977734    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:20.984295 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:20.984267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcc5k\" (UniqueName: \"kubernetes.io/projected/f91e1e6f-bcbb-40dd-a876-a26ec7acfebd-kube-api-access-rcc5k\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-p4qmz\" (UID: \"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:21.122669 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:21.122572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:21.400061 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:21.399988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"]
Sep 16 21:57:21.403244 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:57:21.403216    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91e1e6f_bcbb_40dd_a876_a26ec7acfebd.slice/crio-70e238bdd6be053bb12fe26a9b1ebb03cca8933500139c6acf562fcdfe413237 WatchSource:0}: Error finding container 70e238bdd6be053bb12fe26a9b1ebb03cca8933500139c6acf562fcdfe413237: Status 404 returned error can't find the container with id 70e238bdd6be053bb12fe26a9b1ebb03cca8933500139c6acf562fcdfe413237
Sep 16 21:57:21.705886 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:21.705802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz" event={"ID":"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd","Type":"ContainerStarted","Data":"70e238bdd6be053bb12fe26a9b1ebb03cca8933500139c6acf562fcdfe413237"}
Sep 16 21:57:24.720691 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:24.720643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz" event={"ID":"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd","Type":"ContainerStarted","Data":"637c34be37e315c4d6af222870f8896156a8b9ce3db9e3afb70bf203b778e472"}
Sep 16 21:57:25.726795 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:25.726701    2561 generic.go:356] "Generic (PLEG): container finished" podID="f91e1e6f-bcbb-40dd-a876-a26ec7acfebd" containerID="637c34be37e315c4d6af222870f8896156a8b9ce3db9e3afb70bf203b778e472" exitCode=0
Sep 16 21:57:25.726795 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:25.726746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz" event={"ID":"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd","Type":"ContainerDied","Data":"637c34be37e315c4d6af222870f8896156a8b9ce3db9e3afb70bf203b778e472"}
Sep 16 21:57:26.738200 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:26.738165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz" event={"ID":"f91e1e6f-bcbb-40dd-a876-a26ec7acfebd","Type":"ContainerStarted","Data":"3d9224868bf292c2f7fbced611c7f5176fc4f4e2b8de094fafa6e6b133cf16ca"}
Sep 16 21:57:26.738583 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:26.738272    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:26.756805 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:26.756758    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz" podStartSLOduration=2.538326956 podStartE2EDuration="6.756742531s" totalImagesPullingTime="3.212394722s" totalInitContainerRuntime="1.006020853s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:26.755393122 +0000 UTC m=+503.308000826" watchObservedRunningTime="2026-09-16 21:57:26.756742531 +0000 UTC m=+503.309350234"
Sep 16 21:57:37.743423 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:37.743393    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-p4qmz"
Sep 16 21:57:50.218502 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.218464    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"]
Sep 16 21:57:50.228270 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.228240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.229926 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.229879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"]
Sep 16 21:57:50.230227 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.230208    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 21:57:50.230323 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.230223    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rmz6n\""
Sep 16 21:57:50.230323 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.230210    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 21:57:50.328183 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.328151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fns7d\" (UniqueName: \"kubernetes.io/projected/3e5e0072-7764-40d9-b2ad-31aa849583fc-kube-api-access-fns7d\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.328183 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.328182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5e0072-7764-40d9-b2ad-31aa849583fc-tmp\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.328399 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.328207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5e0072-7764-40d9-b2ad-31aa849583fc-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.429072 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.429042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5e0072-7764-40d9-b2ad-31aa849583fc-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.429248 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.429126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fns7d\" (UniqueName: \"kubernetes.io/projected/3e5e0072-7764-40d9-b2ad-31aa849583fc-kube-api-access-fns7d\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.429248 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.429144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5e0072-7764-40d9-b2ad-31aa849583fc-tmp\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.431374 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.431346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5e0072-7764-40d9-b2ad-31aa849583fc-tmp\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.431574 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.431557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5e0072-7764-40d9-b2ad-31aa849583fc-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.453755 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.453730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fns7d\" (UniqueName: \"kubernetes.io/projected/3e5e0072-7764-40d9-b2ad-31aa849583fc-kube-api-access-fns7d\") pod \"kube-auth-proxy-6c57876cd9-4bdgf\" (UID: \"3e5e0072-7764-40d9-b2ad-31aa849583fc\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.537939 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.537865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"
Sep 16 21:57:50.811370 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.811324    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf"]
Sep 16 21:57:50.814001 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:57:50.813968    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5e0072_7764_40d9_b2ad_31aa849583fc.slice/crio-453c14f537515f4671677083028759564cdc893fa3af1c0c685cda90d78767b4 WatchSource:0}: Error finding container 453c14f537515f4671677083028759564cdc893fa3af1c0c685cda90d78767b4: Status 404 returned error can't find the container with id 453c14f537515f4671677083028759564cdc893fa3af1c0c685cda90d78767b4
Sep 16 21:57:50.831250 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:50.831217    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf" event={"ID":"3e5e0072-7764-40d9-b2ad-31aa849583fc","Type":"ContainerStarted","Data":"453c14f537515f4671677083028759564cdc893fa3af1c0c685cda90d78767b4"}
Sep 16 21:57:53.850141 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:53.850083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf" event={"ID":"3e5e0072-7764-40d9-b2ad-31aa849583fc","Type":"ContainerStarted","Data":"250aefdf045c56c7c4522cc5fab4de238d9ee5da33fd51940e73079436a6ecbe"}
Sep 16 21:57:53.865404 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:53.865319    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-4bdgf" podStartSLOduration=1.06525328 podStartE2EDuration="3.865303365s" totalImagesPullingTime="2.800050085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:53.863757301 +0000 UTC m=+530.416365005" watchObservedRunningTime="2026-09-16 21:57:53.865303365 +0000 UTC m=+530.417911068"
Sep 16 21:57:59.481890 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.481808    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"]
Sep 16 21:57:59.485150 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.485128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.487763 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.487740    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 21:57:59.487763 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.487738    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 21:57:59.487923 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.487743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dbs2l\""
Sep 16 21:57:59.487923 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.487777    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:57:59.487923 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.487869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 21:57:59.488067 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.488050    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 21:57:59.500151 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.500122    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"]
Sep 16 21:57:59.607564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.607525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.607564 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.607562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.607787 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.607592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxxbq\" (UniqueName: \"kubernetes.io/projected/ec09c467-2072-4f5e-a1be-53d27b53569d-kube-api-access-gxxbq\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.607787 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.607700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec09c467-2072-4f5e-a1be-53d27b53569d-manager-config\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.708887 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.708840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec09c467-2072-4f5e-a1be-53d27b53569d-manager-config\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.709048 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.708927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.709048 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.708980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.709048 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.709020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxxbq\" (UniqueName: \"kubernetes.io/projected/ec09c467-2072-4f5e-a1be-53d27b53569d-kube-api-access-gxxbq\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.709524 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.709502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec09c467-2072-4f5e-a1be-53d27b53569d-manager-config\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.711350 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.711331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.711433 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.711384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec09c467-2072-4f5e-a1be-53d27b53569d-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.727360 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.727333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxxbq\" (UniqueName: \"kubernetes.io/projected/ec09c467-2072-4f5e-a1be-53d27b53569d-kube-api-access-gxxbq\") pod \"lws-controller-manager-68dbcd7456-qgnpq\" (UID: \"ec09c467-2072-4f5e-a1be-53d27b53569d\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:57:59.794304 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:57:59.794274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:58:00.069309 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:00.069283    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"]
Sep 16 21:58:00.071794 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:58:00.071769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec09c467_2072_4f5e_a1be_53d27b53569d.slice/crio-af2fc53a9bcd3810836a9f448990d7398488946d571f0c9b1897f907b419daa1 WatchSource:0}: Error finding container af2fc53a9bcd3810836a9f448990d7398488946d571f0c9b1897f907b419daa1: Status 404 returned error can't find the container with id af2fc53a9bcd3810836a9f448990d7398488946d571f0c9b1897f907b419daa1
Sep 16 21:58:00.880996 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:00.880961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq" event={"ID":"ec09c467-2072-4f5e-a1be-53d27b53569d","Type":"ContainerStarted","Data":"af2fc53a9bcd3810836a9f448990d7398488946d571f0c9b1897f907b419daa1"}
Sep 16 21:58:03.896264 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:03.896224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq" event={"ID":"ec09c467-2072-4f5e-a1be-53d27b53569d","Type":"ContainerStarted","Data":"8cdbfbf6e7506e00ab266b86d011b5a83fbd08a43d4d9f8695ccf102fde04978"}
Sep 16 21:58:03.896685 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:03.896311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:58:03.913781 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:03.913737    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq" podStartSLOduration=2.14777534 podStartE2EDuration="4.913719737s" totalImagesPullingTime="2.765944397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:03.912659387 +0000 UTC m=+540.465267105" watchObservedRunningTime="2026-09-16 21:58:03.913719737 +0000 UTC m=+540.466327441"
Sep 16 21:58:14.903247 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:58:14.903212    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-qgnpq"
Sep 16 21:59:03.889952 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:03.889849    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:59:03.893890 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:03.890114    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 21:59:03.897371 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:03.897349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:59:03.897562 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:03.897542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 21:59:37.925301 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.925268    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"]
Sep 16 21:59:37.928401 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.928382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:37.930498 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.930468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 16 21:59:37.930603 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.930529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 21:59:37.930603 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.930560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 21:59:37.931215 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.931195    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfr57\""
Sep 16 21:59:37.931299 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.931277    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 16 21:59:37.934600 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:37.934581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"]
Sep 16 21:59:38.027790 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.027755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f44f686-4ae6-41b9-b14e-9bb83478295b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.027957 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.027795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmw2\" (UniqueName: \"kubernetes.io/projected/7f44f686-4ae6-41b9-b14e-9bb83478295b-kube-api-access-6gmw2\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.027957 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.027829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f44f686-4ae6-41b9-b14e-9bb83478295b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.129091 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.129050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f44f686-4ae6-41b9-b14e-9bb83478295b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.129091 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.129090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmw2\" (UniqueName: \"kubernetes.io/projected/7f44f686-4ae6-41b9-b14e-9bb83478295b-kube-api-access-6gmw2\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.129313 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.129138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f44f686-4ae6-41b9-b14e-9bb83478295b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.129838 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.129815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f44f686-4ae6-41b9-b14e-9bb83478295b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.131518 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.131496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f44f686-4ae6-41b9-b14e-9bb83478295b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.136199 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.136176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmw2\" (UniqueName: \"kubernetes.io/projected/7f44f686-4ae6-41b9-b14e-9bb83478295b-kube-api-access-6gmw2\") pod \"kuadrant-console-plugin-fbdd4f445-62xx9\" (UID: \"7f44f686-4ae6-41b9-b14e-9bb83478295b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.248967 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.248863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"
Sep 16 21:59:38.519293 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.519270    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9"]
Sep 16 21:59:38.521905 ip-10-0-138-103 kubenswrapper[2561]: W0916 21:59:38.521873    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f44f686_4ae6_41b9_b14e_9bb83478295b.slice/crio-9a864594030799819e29703aea82c583d7455842894c3306807063e3b6ecf9f3 WatchSource:0}: Error finding container 9a864594030799819e29703aea82c583d7455842894c3306807063e3b6ecf9f3: Status 404 returned error can't find the container with id 9a864594030799819e29703aea82c583d7455842894c3306807063e3b6ecf9f3
Sep 16 21:59:38.523280 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:38.523260    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:59:39.291900 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:39.291867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9" event={"ID":"7f44f686-4ae6-41b9-b14e-9bb83478295b","Type":"ContainerStarted","Data":"9a864594030799819e29703aea82c583d7455842894c3306807063e3b6ecf9f3"}
Sep 16 21:59:44.316469 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:44.316428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9" event={"ID":"7f44f686-4ae6-41b9-b14e-9bb83478295b","Type":"ContainerStarted","Data":"dba427a598ca841910fde5b82a150d21f8b53833a1eaf83da2867bd5993e2f54"}
Sep 16 21:59:44.331859 ip-10-0-138-103 kubenswrapper[2561]: I0916 21:59:44.331810    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-62xx9" podStartSLOduration=2.530828805 podStartE2EDuration="7.331793831s" totalImagesPullingTime="4.800965026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:44.330648518 +0000 UTC m=+640.883256221" watchObservedRunningTime="2026-09-16 21:59:44.331793831 +0000 UTC m=+640.884401533"
Sep 16 22:00:19.434484 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.434445    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:19.451198 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.451162    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:19.451362 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.451263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.454182 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.454160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 22:00:19.501065 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.501019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76sbj\" (UniqueName: \"kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.501260 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.501185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.533580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.533545    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:19.602638 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.602602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76sbj\" (UniqueName: \"kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.602837 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.602648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.603234 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.603217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.610357 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.610330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76sbj\" (UniqueName: \"kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj\") pod \"limitador-limitador-8588749977-748ml\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") " pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:19.761773 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:19.761681    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:20.028599 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.028509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:20.031553 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:00:20.031529    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a22e14_f5b7_49ca_a112_0958dbfe4a7b.slice/crio-36c99e5a8fceff5b5c837ddbf0b46f0aea432debe5bf599302982f697a799790 WatchSource:0}: Error finding container 36c99e5a8fceff5b5c837ddbf0b46f0aea432debe5bf599302982f697a799790: Status 404 returned error can't find the container with id 36c99e5a8fceff5b5c837ddbf0b46f0aea432debe5bf599302982f697a799790
Sep 16 22:00:20.218043 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.218003    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:20.221028 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.221006    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:20.222886 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.222867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ktrm\""
Sep 16 22:00:20.227805 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.227782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:20.307945 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.307903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfzbz\" (UniqueName: \"kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz\") pod \"authorino-7bcfd8f9cd-vw6db\" (UID: \"15a34f43-b2b8-46db-8c1d-8657a8aa30dc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:20.408662 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.408624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfzbz\" (UniqueName: \"kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz\") pod \"authorino-7bcfd8f9cd-vw6db\" (UID: \"15a34f43-b2b8-46db-8c1d-8657a8aa30dc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:20.416466 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.416431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfzbz\" (UniqueName: \"kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz\") pod \"authorino-7bcfd8f9cd-vw6db\" (UID: \"15a34f43-b2b8-46db-8c1d-8657a8aa30dc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:20.471590 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.471557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-748ml" event={"ID":"93a22e14-f5b7-49ca-a112-0958dbfe4a7b","Type":"ContainerStarted","Data":"36c99e5a8fceff5b5c837ddbf0b46f0aea432debe5bf599302982f697a799790"}
Sep 16 22:00:20.531675 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.531638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:20.797343 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:20.797311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:20.800518 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:00:20.800489    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15a34f43_b2b8_46db_8c1d_8657a8aa30dc.slice/crio-8ae1bb45c593f0380537971180aef5dcd6c2bdafffc11d19a31faa8ee1abf488 WatchSource:0}: Error finding container 8ae1bb45c593f0380537971180aef5dcd6c2bdafffc11d19a31faa8ee1abf488: Status 404 returned error can't find the container with id 8ae1bb45c593f0380537971180aef5dcd6c2bdafffc11d19a31faa8ee1abf488
Sep 16 22:00:21.477793 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:21.477749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" event={"ID":"15a34f43-b2b8-46db-8c1d-8657a8aa30dc","Type":"ContainerStarted","Data":"8ae1bb45c593f0380537971180aef5dcd6c2bdafffc11d19a31faa8ee1abf488"}
Sep 16 22:00:23.491225 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:23.491142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-748ml" event={"ID":"93a22e14-f5b7-49ca-a112-0958dbfe4a7b","Type":"ContainerStarted","Data":"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"}
Sep 16 22:00:23.491613 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:23.491279    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:23.506974 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:23.506917    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-748ml" podStartSLOduration=1.82196428 podStartE2EDuration="4.506902586s" totalImagesPullingTime="2.684938306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:23.504998978 +0000 UTC m=+680.057606686" watchObservedRunningTime="2026-09-16 22:00:23.506902586 +0000 UTC m=+680.059510289"
Sep 16 22:00:24.496730 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:24.496694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" event={"ID":"15a34f43-b2b8-46db-8c1d-8657a8aa30dc","Type":"ContainerStarted","Data":"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"}
Sep 16 22:00:24.512023 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:24.511979    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" podStartSLOduration=1.341006584 podStartE2EDuration="4.511959876s" totalImagesPullingTime="3.170953292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:24.51019113 +0000 UTC m=+681.062798832" watchObservedRunningTime="2026-09-16 22:00:24.511959876 +0000 UTC m=+681.064567580"
Sep 16 22:00:26.518626 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.518593    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:26.519091 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.518781    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" podUID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" containerName="authorino" containerID="cri-o://0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe" gracePeriod=30
Sep 16 22:00:26.747486 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.747459    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:26.866819 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.866779    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfzbz\" (UniqueName: \"kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz\") pod \"15a34f43-b2b8-46db-8c1d-8657a8aa30dc\" (UID: \"15a34f43-b2b8-46db-8c1d-8657a8aa30dc\") "
Sep 16 22:00:26.868954 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.868929    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz" (OuterVolumeSpecName: "kube-api-access-sfzbz") pod "15a34f43-b2b8-46db-8c1d-8657a8aa30dc" (UID: "15a34f43-b2b8-46db-8c1d-8657a8aa30dc"). InnerVolumeSpecName "kube-api-access-sfzbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:26.967416 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:26.967375    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfzbz\" (UniqueName: \"kubernetes.io/projected/15a34f43-b2b8-46db-8c1d-8657a8aa30dc-kube-api-access-sfzbz\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:27.510342 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.510312    2561 generic.go:356] "Generic (PLEG): container finished" podID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" containerID="0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe" exitCode=0
Sep 16 22:00:27.510505 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.510349    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db"
Sep 16 22:00:27.510505 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.510352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" event={"ID":"15a34f43-b2b8-46db-8c1d-8657a8aa30dc","Type":"ContainerDied","Data":"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"}
Sep 16 22:00:27.510505 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.510461    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-vw6db" event={"ID":"15a34f43-b2b8-46db-8c1d-8657a8aa30dc","Type":"ContainerDied","Data":"8ae1bb45c593f0380537971180aef5dcd6c2bdafffc11d19a31faa8ee1abf488"}
Sep 16 22:00:27.510505 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.510481    2561 scope.go:117] "RemoveContainer" containerID="0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"
Sep 16 22:00:27.518978 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.518960    2561 scope.go:117] "RemoveContainer" containerID="0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"
Sep 16 22:00:27.519298 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:00:27.519221    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe\": container with ID starting with 0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe not found: ID does not exist" containerID="0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"
Sep 16 22:00:27.519298 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.519246    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe"} err="failed to get container status \"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe\": rpc error: code = NotFound desc = could not find container \"0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe\": container with ID starting with 0a8f42050f1a13679269d6f6c04ee4d00abc3e5dec8ea49c696cb1b4bfed88fe not found: ID does not exist"
Sep 16 22:00:27.529700 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.529675    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:27.531738 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.531717    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-vw6db"]
Sep 16 22:00:27.925217 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:27.925187    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" path="/var/lib/kubelet/pods/15a34f43-b2b8-46db-8c1d-8657a8aa30dc/volumes"
Sep 16 22:00:33.503375 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:33.503339    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:33.503791 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:33.503513    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-748ml" podUID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" containerName="limitador" containerID="cri-o://9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19" gracePeriod=30
Sep 16 22:00:33.504265 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:33.504216    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:34.052975 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.052947    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:34.131713 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.131632    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76sbj\" (UniqueName: \"kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj\") pod \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") "
Sep 16 22:00:34.131713 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.131696    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file\") pod \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\" (UID: \"93a22e14-f5b7-49ca-a112-0958dbfe4a7b\") "
Sep 16 22:00:34.132048 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.132026    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file" (OuterVolumeSpecName: "config-file") pod "93a22e14-f5b7-49ca-a112-0958dbfe4a7b" (UID: "93a22e14-f5b7-49ca-a112-0958dbfe4a7b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 22:00:34.133591 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.133572    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj" (OuterVolumeSpecName: "kube-api-access-76sbj") pod "93a22e14-f5b7-49ca-a112-0958dbfe4a7b" (UID: "93a22e14-f5b7-49ca-a112-0958dbfe4a7b"). InnerVolumeSpecName "kube-api-access-76sbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:34.232473 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.232433    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76sbj\" (UniqueName: \"kubernetes.io/projected/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-kube-api-access-76sbj\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:34.232473 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.232466    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93a22e14-f5b7-49ca-a112-0958dbfe4a7b-config-file\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:34.540881 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.540792    2561 generic.go:356] "Generic (PLEG): container finished" podID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" containerID="9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19" exitCode=0
Sep 16 22:00:34.540881 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.540836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-748ml"
Sep 16 22:00:34.540881 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.540842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-748ml" event={"ID":"93a22e14-f5b7-49ca-a112-0958dbfe4a7b","Type":"ContainerDied","Data":"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"}
Sep 16 22:00:34.541377 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.540891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-748ml" event={"ID":"93a22e14-f5b7-49ca-a112-0958dbfe4a7b","Type":"ContainerDied","Data":"36c99e5a8fceff5b5c837ddbf0b46f0aea432debe5bf599302982f697a799790"}
Sep 16 22:00:34.541377 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.540916    2561 scope.go:117] "RemoveContainer" containerID="9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"
Sep 16 22:00:34.549353 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.549331    2561 scope.go:117] "RemoveContainer" containerID="9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"
Sep 16 22:00:34.549628 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:00:34.549610    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19\": container with ID starting with 9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19 not found: ID does not exist" containerID="9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"
Sep 16 22:00:34.549678 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.549638    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19"} err="failed to get container status \"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19\": rpc error: code = NotFound desc = could not find container \"9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19\": container with ID starting with 9dd843392d2fde9afc7020f2e183682e94c8012f429546461301cbffd5167e19 not found: ID does not exist"
Sep 16 22:00:34.571038 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.571007    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:34.577889 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:34.577859    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-748ml"]
Sep 16 22:00:35.925273 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.925238    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" path="/var/lib/kubelet/pods/93a22e14-f5b7-49ca-a112-0958dbfe4a7b/volumes"
Sep 16 22:00:35.991632 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.991597    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"]
Sep 16 22:00:35.991925 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.991913    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" containerName="authorino"
Sep 16 22:00:35.991979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.991928    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" containerName="authorino"
Sep 16 22:00:35.991979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.991942    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" containerName="limitador"
Sep 16 22:00:35.991979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.991947    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" containerName="limitador"
Sep 16 22:00:35.992073 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.992006    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a22e14-f5b7-49ca-a112-0958dbfe4a7b" containerName="limitador"
Sep 16 22:00:35.992073 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.992018    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a34f43-b2b8-46db-8c1d-8657a8aa30dc" containerName="authorino"
Sep 16 22:00:35.995053 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.995034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:35.997358 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.997332    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 22:00:35.997806 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.997785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-fzqrv\""
Sep 16 22:00:35.997806 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.997786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 22:00:35.997979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:35.997815    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 22:00:36.015413 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.015376    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"]
Sep 16 22:00:36.049165 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.049129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/68e26e45-3643-4e38-90af-43609b5ea4f0-data\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.049356 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.049181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwjc\" (UniqueName: \"kubernetes.io/projected/68e26e45-3643-4e38-90af-43609b5ea4f0-kube-api-access-6cwjc\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.150195 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.150153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/68e26e45-3643-4e38-90af-43609b5ea4f0-data\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.150368 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.150215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwjc\" (UniqueName: \"kubernetes.io/projected/68e26e45-3643-4e38-90af-43609b5ea4f0-kube-api-access-6cwjc\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.150574 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.150545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/68e26e45-3643-4e38-90af-43609b5ea4f0-data\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.157675 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.157642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwjc\" (UniqueName: \"kubernetes.io/projected/68e26e45-3643-4e38-90af-43609b5ea4f0-kube-api-access-6cwjc\") pod \"postgres-69fb4594cf-6n5h6\" (UID: \"68e26e45-3643-4e38-90af-43609b5ea4f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.305774 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.305741    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:36.577750 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:36.577652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"]
Sep 16 22:00:36.579910 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:00:36.579883    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e26e45_3643_4e38_90af_43609b5ea4f0.slice/crio-a813d41a3b28482f780a474ae2d2f06746b1c58e02173554eb2cacbcd517f59a WatchSource:0}: Error finding container a813d41a3b28482f780a474ae2d2f06746b1c58e02173554eb2cacbcd517f59a: Status 404 returned error can't find the container with id a813d41a3b28482f780a474ae2d2f06746b1c58e02173554eb2cacbcd517f59a
Sep 16 22:00:37.557542 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:37.557505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6" event={"ID":"68e26e45-3643-4e38-90af-43609b5ea4f0","Type":"ContainerStarted","Data":"a813d41a3b28482f780a474ae2d2f06746b1c58e02173554eb2cacbcd517f59a"}
Sep 16 22:00:46.605241 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:46.605204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6" event={"ID":"68e26e45-3643-4e38-90af-43609b5ea4f0","Type":"ContainerStarted","Data":"acf99585c62eeebc1dddc6c3451b65e87357fd1ba4e4fefe505de2d5dda367f3"}
Sep 16 22:00:46.605614 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:46.605273    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:46.619824 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:46.619758    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6" podStartSLOduration=2.528854419 podStartE2EDuration="11.619735398s" totalImagesPullingTime="9.090880979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:46.618753939 +0000 UTC m=+703.171361642" watchObservedRunningTime="2026-09-16 22:00:46.619735398 +0000 UTC m=+703.172343107"
Sep 16 22:00:52.638540 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:52.638509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6n5h6"
Sep 16 22:00:53.184904 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.184871    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-h9nxk"]
Sep 16 22:00:53.191637 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.191615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.193729 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.193691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ktrm\""
Sep 16 22:00:53.194183 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.194157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-h9nxk"]
Sep 16 22:00:53.294527 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.294491    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-h9nxk"]
Sep 16 22:00:53.294755 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:00:53.294736    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h7nvr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-h9nxk" podUID="e18c6513-c132-4f94-bd69-e1f5c018e33a"
Sep 16 22:00:53.303832 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.303806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7nvr\" (UniqueName: \"kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr\") pod \"authorino-557f876f69-h9nxk\" (UID: \"e18c6513-c132-4f94-bd69-e1f5c018e33a\") " pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.316233 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.316196    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-l8l5v"]
Sep 16 22:00:53.320094 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.320073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.321988 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.321967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 16 22:00:53.326574 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.326550    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-l8l5v"]
Sep 16 22:00:53.405232 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.405193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7nvr\" (UniqueName: \"kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr\") pod \"authorino-557f876f69-h9nxk\" (UID: \"e18c6513-c132-4f94-bd69-e1f5c018e33a\") " pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.405445 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.405255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.405445 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.405303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4s5\" (UniqueName: \"kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.412327 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.412302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7nvr\" (UniqueName: \"kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr\") pod \"authorino-557f876f69-h9nxk\" (UID: \"e18c6513-c132-4f94-bd69-e1f5c018e33a\") " pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.437560 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.437482    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-l8l5v"]
Sep 16 22:00:53.437747 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:00:53.437727    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xz4s5 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-l8l5v" podUID="880d679f-b117-45f4-a941-a92edd8ece2e"
Sep 16 22:00:53.461154 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.461124    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:00:53.464614 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.464597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.473118 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.473067    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:00:53.506021 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.505980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.506223 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.506063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4s5\" (UniqueName: \"kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.508502 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.508471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.512686 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.512659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4s5\" (UniqueName: \"kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5\") pod \"authorino-6d4dfc649f-l8l5v\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") " pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.606942 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.606899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.607145 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.606976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6rss\" (UniqueName: \"kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.636674 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.636648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.636769 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.636648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.644628 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.644598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:53.647329 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.647311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:53.708164 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.708066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.708313 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.708174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6rss\" (UniqueName: \"kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.710472 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.710449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.715241 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.715218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6rss\" (UniqueName: \"kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss\") pod \"authorino-5d9f7d764d-4j7n2\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") " pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.774953 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.774915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:00:53.808918 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.808879    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert\") pod \"880d679f-b117-45f4-a941-a92edd8ece2e\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") "
Sep 16 22:00:53.809133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.809037    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4s5\" (UniqueName: \"kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5\") pod \"880d679f-b117-45f4-a941-a92edd8ece2e\" (UID: \"880d679f-b117-45f4-a941-a92edd8ece2e\") "
Sep 16 22:00:53.809133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.809081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7nvr\" (UniqueName: \"kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr\") pod \"e18c6513-c132-4f94-bd69-e1f5c018e33a\" (UID: \"e18c6513-c132-4f94-bd69-e1f5c018e33a\") "
Sep 16 22:00:53.811286 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.811245    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5" (OuterVolumeSpecName: "kube-api-access-xz4s5") pod "880d679f-b117-45f4-a941-a92edd8ece2e" (UID: "880d679f-b117-45f4-a941-a92edd8ece2e"). InnerVolumeSpecName "kube-api-access-xz4s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:53.811900 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.811872    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "880d679f-b117-45f4-a941-a92edd8ece2e" (UID: "880d679f-b117-45f4-a941-a92edd8ece2e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 22:00:53.812057 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.811888    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr" (OuterVolumeSpecName: "kube-api-access-h7nvr") pod "e18c6513-c132-4f94-bd69-e1f5c018e33a" (UID: "e18c6513-c132-4f94-bd69-e1f5c018e33a"). InnerVolumeSpecName "kube-api-access-h7nvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:53.910491 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.910449    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7nvr\" (UniqueName: \"kubernetes.io/projected/e18c6513-c132-4f94-bd69-e1f5c018e33a-kube-api-access-h7nvr\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:53.910491 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.910484    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/880d679f-b117-45f4-a941-a92edd8ece2e-tls-cert\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:53.910491 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:53.910497    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4s5\" (UniqueName: \"kubernetes.io/projected/880d679f-b117-45f4-a941-a92edd8ece2e-kube-api-access-xz4s5\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:00:54.045121 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.045083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:00:54.047193 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:00:54.047164    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bbedc8d_1ead_4855_b113_dc6667de743e.slice/crio-8048f9e006064d9a1d00b7fd118e6717e35c14d98076bf21dd0d1710d381ad34 WatchSource:0}: Error finding container 8048f9e006064d9a1d00b7fd118e6717e35c14d98076bf21dd0d1710d381ad34: Status 404 returned error can't find the container with id 8048f9e006064d9a1d00b7fd118e6717e35c14d98076bf21dd0d1710d381ad34
Sep 16 22:00:54.642544 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.642504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" event={"ID":"5bbedc8d-1ead-4855-b113-dc6667de743e","Type":"ContainerStarted","Data":"8048f9e006064d9a1d00b7fd118e6717e35c14d98076bf21dd0d1710d381ad34"}
Sep 16 22:00:54.642544 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.642532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-l8l5v"
Sep 16 22:00:54.642806 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.642522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-h9nxk"
Sep 16 22:00:54.669337 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.669258    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-l8l5v"]
Sep 16 22:00:54.672815 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.672785    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-l8l5v"]
Sep 16 22:00:54.690183 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.690152    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-h9nxk"]
Sep 16 22:00:54.694473 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:54.694447    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-h9nxk"]
Sep 16 22:00:55.648566 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:55.648531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" event={"ID":"5bbedc8d-1ead-4855-b113-dc6667de743e","Type":"ContainerStarted","Data":"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"}
Sep 16 22:00:55.662450 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:55.662405    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" podStartSLOduration=2.005132665 podStartE2EDuration="2.662389453s" totalImagesPullingTime="657.256788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:55.661493459 +0000 UTC m=+712.214101166" watchObservedRunningTime="2026-09-16 22:00:55.662389453 +0000 UTC m=+712.214997155"
Sep 16 22:00:55.925789 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:55.925700    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="880d679f-b117-45f4-a941-a92edd8ece2e" path="/var/lib/kubelet/pods/880d679f-b117-45f4-a941-a92edd8ece2e/volumes"
Sep 16 22:00:55.926169 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:00:55.925932    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18c6513-c132-4f94-bd69-e1f5c018e33a" path="/var/lib/kubelet/pods/e18c6513-c132-4f94-bd69-e1f5c018e33a/volumes"
Sep 16 22:01:36.221844 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.221806    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"]
Sep 16 22:01:36.224065 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.224048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.226001 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.225983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 22:01:36.226085 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.226003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 22:01:36.226181 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.226164    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hqs9t\""
Sep 16 22:01:36.236296 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.236267    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"]
Sep 16 22:01:36.372138 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.372074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4bhf\" (UniqueName: \"kubernetes.io/projected/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-kube-api-access-s4bhf\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.372317 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.372187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-openshift-service-ca\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.372317 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.372208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.372317 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.372232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.473295 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.473205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4bhf\" (UniqueName: \"kubernetes.io/projected/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-kube-api-access-s4bhf\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.473295 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.473262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-openshift-service-ca\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.473493 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.473327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.473493 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.473382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.473493 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:01:36.473431    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 16 22:01:36.473608 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:01:36.473507    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs podName:8a17a5fe-fac5-4f57-96d2-bcf7d53d1532 nodeName:}" failed. No retries permitted until 2026-09-16 22:01:36.973486265 +0000 UTC m=+753.526093960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs") pod "maas-api-59f6566bbc-xpcp2" (UID: "8a17a5fe-fac5-4f57-96d2-bcf7d53d1532") : secret "maas-api-metrics-tls" not found
Sep 16 22:01:36.473608 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:01:36.473533    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 16 22:01:36.473608 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:01:36.473579    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls podName:8a17a5fe-fac5-4f57-96d2-bcf7d53d1532 nodeName:}" failed. No retries permitted until 2026-09-16 22:01:36.973566639 +0000 UTC m=+753.526174327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls") pod "maas-api-59f6566bbc-xpcp2" (UID: "8a17a5fe-fac5-4f57-96d2-bcf7d53d1532") : secret "maas-api-serving-cert" not found
Sep 16 22:01:36.473842 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.473825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-openshift-service-ca\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.483318 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.483286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4bhf\" (UniqueName: \"kubernetes.io/projected/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-kube-api-access-s4bhf\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.978457 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.978419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.978457 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.978460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.981010 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.980979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-metrics-certs\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:36.981010 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:36.980998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17a5fe-fac5-4f57-96d2-bcf7d53d1532-maas-api-tls\") pod \"maas-api-59f6566bbc-xpcp2\" (UID: \"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:37.134376 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:37.134333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:37.415492 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:37.415467    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"]
Sep 16 22:01:37.417962 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:01:37.417918    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a17a5fe_fac5_4f57_96d2_bcf7d53d1532.slice/crio-0d2efa8bcaabeb52f35cd6246d9c7525d4489b630da47a98c982ce40f9cf3111 WatchSource:0}: Error finding container 0d2efa8bcaabeb52f35cd6246d9c7525d4489b630da47a98c982ce40f9cf3111: Status 404 returned error can't find the container with id 0d2efa8bcaabeb52f35cd6246d9c7525d4489b630da47a98c982ce40f9cf3111
Sep 16 22:01:37.831446 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:37.831413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2" event={"ID":"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532","Type":"ContainerStarted","Data":"0d2efa8bcaabeb52f35cd6246d9c7525d4489b630da47a98c982ce40f9cf3111"}
Sep 16 22:01:40.849145 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:40.849082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2" event={"ID":"8a17a5fe-fac5-4f57-96d2-bcf7d53d1532","Type":"ContainerStarted","Data":"c980cf32306f5678afcf23d28c88c9ebd8424d34ee07279bce3894f6b3d694e5"}
Sep 16 22:01:40.849552 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:40.849169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:01:40.870737 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:40.870693    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2" podStartSLOduration=2.495488778 podStartE2EDuration="4.870677876s" totalImagesPullingTime="2.375189098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:01:40.869250818 +0000 UTC m=+757.421858521" watchObservedRunningTime="2026-09-16 22:01:40.870677876 +0000 UTC m=+757.423285579"
Sep 16 22:01:46.859120 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:01:46.859079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xpcp2"
Sep 16 22:02:08.276646 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.276610    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"]
Sep 16 22:02:08.281614 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.281593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.283999 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.283979    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 22:02:08.284375 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.284358    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qf59f\""
Sep 16 22:02:08.284444 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.284385    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 22:02:08.284444 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.284358    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 22:02:08.289095 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.288680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"]
Sep 16 22:02:08.326162 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.326304 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.326344 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.326344 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.326422 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c46a35-1046-4b75-97f9-f3efced46638-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.326422 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.326382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm952\" (UniqueName: \"kubernetes.io/projected/41c46a35-1046-4b75-97f9-f3efced46638-kube-api-access-cm952\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.426777 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.426777 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427030 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c46a35-1046-4b75-97f9-f3efced46638-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427030 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm952\" (UniqueName: \"kubernetes.io/projected/41c46a35-1046-4b75-97f9-f3efced46638-kube-api-access-cm952\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427030 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427030 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.426917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427257 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.427234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427306 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.427258    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.427306 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.427284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.429180 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.429149    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c46a35-1046-4b75-97f9-f3efced46638-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.429384 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.429366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c46a35-1046-4b75-97f9-f3efced46638-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.434377 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.434353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm952\" (UniqueName: \"kubernetes.io/projected/41c46a35-1046-4b75-97f9-f3efced46638-kube-api-access-cm952\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ncjdn\" (UID: \"41c46a35-1046-4b75-97f9-f3efced46638\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.592811 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.592765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:08.862725 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.862700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"]
Sep 16 22:02:08.865402 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:02:08.865376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c46a35_1046_4b75_97f9_f3efced46638.slice/crio-830d64fa1b490daa434ebc2452054e3f3279174f6d367469c4fdd8abcba143b3 WatchSource:0}: Error finding container 830d64fa1b490daa434ebc2452054e3f3279174f6d367469c4fdd8abcba143b3: Status 404 returned error can't find the container with id 830d64fa1b490daa434ebc2452054e3f3279174f6d367469c4fdd8abcba143b3
Sep 16 22:02:08.978730 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:08.978698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn" event={"ID":"41c46a35-1046-4b75-97f9-f3efced46638","Type":"ContainerStarted","Data":"830d64fa1b490daa434ebc2452054e3f3279174f6d367469c4fdd8abcba143b3"}
Sep 16 22:02:10.992162 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:10.992122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn" event={"ID":"41c46a35-1046-4b75-97f9-f3efced46638","Type":"ContainerStarted","Data":"139d9bad935b5ffd0dc7ee134497b7962c8ca6545b1b8343e93d76bc7a4a8dc8"}
Sep 16 22:02:11.008773 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:11.008724    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn" podStartSLOduration=1.949708048 podStartE2EDuration="3.008706297s" totalImagesPullingTime="1.058998249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:11.007478947 +0000 UTC m=+787.560086650" watchObservedRunningTime="2026-09-16 22:02:11.008706297 +0000 UTC m=+787.561314000"
Sep 16 22:02:18.593008 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:18.592963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:18.593431 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:18.593078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:18.605442 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:18.605416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:19.037985 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:19.037905    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ncjdn"
Sep 16 22:02:28.274145 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.274052    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"]
Sep 16 22:02:28.277819 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.277780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.279856 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.279836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 22:02:28.286372 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.286350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"]
Sep 16 22:02:28.396386 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7161e0-91c7-4233-a921-aecc0417221b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.396580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.396580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.396580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.396580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbsx9\" (UniqueName: \"kubernetes.io/projected/5e7161e0-91c7-4233-a921-aecc0417221b-kube-api-access-fbsx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.396580 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.396534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.497795 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.497716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.497979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.497845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7161e0-91c7-4233-a921-aecc0417221b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.497979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.497901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.497979 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.497928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.498175 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.497988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.498175 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.498016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbsx9\" (UniqueName: \"kubernetes.io/projected/5e7161e0-91c7-4233-a921-aecc0417221b-kube-api-access-fbsx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.498361 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.498338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.498426 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.498380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.498426 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.498395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.500147 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.500129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7161e0-91c7-4233-a921-aecc0417221b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.500329 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.500310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7161e0-91c7-4233-a921-aecc0417221b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.506157 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.506135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbsx9\" (UniqueName: \"kubernetes.io/projected/5e7161e0-91c7-4233-a921-aecc0417221b-kube-api-access-fbsx9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pch9x\" (UID: \"5e7161e0-91c7-4233-a921-aecc0417221b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.589061 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.589023    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:28.857794 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:28.857752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"]
Sep 16 22:02:28.860603 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:02:28.860576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7161e0_91c7_4233_a921_aecc0417221b.slice/crio-67d747d0793ae681bfad62689b0b62e2b854b53c488ce1c7185fbf261f67cb19 WatchSource:0}: Error finding container 67d747d0793ae681bfad62689b0b62e2b854b53c488ce1c7185fbf261f67cb19: Status 404 returned error can't find the container with id 67d747d0793ae681bfad62689b0b62e2b854b53c488ce1c7185fbf261f67cb19
Sep 16 22:02:29.076570 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:29.076540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x" event={"ID":"5e7161e0-91c7-4233-a921-aecc0417221b","Type":"ContainerStarted","Data":"67d747d0793ae681bfad62689b0b62e2b854b53c488ce1c7185fbf261f67cb19"}
Sep 16 22:02:30.084487 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:30.084437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x" event={"ID":"5e7161e0-91c7-4233-a921-aecc0417221b","Type":"ContainerStarted","Data":"b4f03535becbbb996d9442cc3a080f49cf3ebaf61f65ad65222e71df8ad1ccc3"}
Sep 16 22:02:30.102775 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:30.102719    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x" podStartSLOduration=1.931174309 podStartE2EDuration="2.102701618s" totalImagesPullingTime="171.527309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:30.100519282 +0000 UTC m=+806.653126983" watchObservedRunningTime="2026-09-16 22:02:30.102701618 +0000 UTC m=+806.655309320"
Sep 16 22:02:38.589367 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:38.589326    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:38.589854 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:38.589419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:38.602246 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:38.602217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:39.134944 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:39.134915    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pch9x"
Sep 16 22:02:55.877395 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.877357    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"]
Sep 16 22:02:55.883910 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.883885    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.886449 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.886418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 22:02:55.888048 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.888022    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"]
Sep 16 22:02:55.938799 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.938763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.939009 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.938825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.939009 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.938877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2wm7\" (UniqueName: \"kubernetes.io/projected/042ff40d-7a65-4448-8efc-429a10dbebe8-kube-api-access-m2wm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.939009 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.938983    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042ff40d-7a65-4448-8efc-429a10dbebe8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.939270 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.939250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:55.939663 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:55.939518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.039986 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.039945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042ff40d-7a65-4448-8efc-429a10dbebe8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.039986 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.039993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040258 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040258 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040258 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040258 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2wm7\" (UniqueName: \"kubernetes.io/projected/042ff40d-7a65-4448-8efc-429a10dbebe8-kube-api-access-m2wm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040513 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040582 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.040582 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.040570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.042257 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.042234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042ff40d-7a65-4448-8efc-429a10dbebe8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.042522 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.042503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042ff40d-7a65-4448-8efc-429a10dbebe8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.047237 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.047217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2wm7\" (UniqueName: \"kubernetes.io/projected/042ff40d-7a65-4448-8efc-429a10dbebe8-kube-api-access-m2wm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bkp77\" (UID: \"042ff40d-7a65-4448-8efc-429a10dbebe8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.197596 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.197501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:02:56.470023 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:56.469972    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"]
Sep 16 22:02:56.472479 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:02:56.472451    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042ff40d_7a65_4448_8efc_429a10dbebe8.slice/crio-3a59ebb96738f4f5b9005e43af0086b09fa9effa3607d4110de2b0a7c4cd1fe7 WatchSource:0}: Error finding container 3a59ebb96738f4f5b9005e43af0086b09fa9effa3607d4110de2b0a7c4cd1fe7: Status 404 returned error can't find the container with id 3a59ebb96738f4f5b9005e43af0086b09fa9effa3607d4110de2b0a7c4cd1fe7
Sep 16 22:02:57.213612 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:57.213571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77" event={"ID":"042ff40d-7a65-4448-8efc-429a10dbebe8","Type":"ContainerStarted","Data":"46037fe2f259f3d5be46094cc133e8982f249962f84c0e151708874fac7f7663"}
Sep 16 22:02:57.214008 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:57.213653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77" event={"ID":"042ff40d-7a65-4448-8efc-429a10dbebe8","Type":"ContainerStarted","Data":"3a59ebb96738f4f5b9005e43af0086b09fa9effa3607d4110de2b0a7c4cd1fe7"}
Sep 16 22:02:57.229824 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:02:57.229774    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77" podStartSLOduration=2.037635824 podStartE2EDuration="2.229758681s" totalImagesPullingTime="192.122857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:57.22782211 +0000 UTC m=+833.780429814" watchObservedRunningTime="2026-09-16 22:02:57.229758681 +0000 UTC m=+833.782366384"
Sep 16 22:03:06.198616 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:03:06.198574    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:03:06.199045 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:03:06.198675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:03:06.211496 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:03:06.211464    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:03:06.264165 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:03:06.264138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bkp77"
Sep 16 22:04:03.919469 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:03.919354    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:04:03.924657 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:03.920891    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:04:03.927415 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:03.927391    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:04:03.928530 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:03.928510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:04:28.641137 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.641083    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:04:28.641567 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.641281    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" podUID="5bbedc8d-1ead-4855-b113-dc6667de743e" containerName="authorino" containerID="cri-o://841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db" gracePeriod=30
Sep 16 22:04:28.877630 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.877604    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:04:28.926380 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.926287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6rss\" (UniqueName: \"kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss\") pod \"5bbedc8d-1ead-4855-b113-dc6667de743e\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") "
Sep 16 22:04:28.926380 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.926379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert\") pod \"5bbedc8d-1ead-4855-b113-dc6667de743e\" (UID: \"5bbedc8d-1ead-4855-b113-dc6667de743e\") "
Sep 16 22:04:28.928440 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.928408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss" (OuterVolumeSpecName: "kube-api-access-n6rss") pod "5bbedc8d-1ead-4855-b113-dc6667de743e" (UID: "5bbedc8d-1ead-4855-b113-dc6667de743e"). InnerVolumeSpecName "kube-api-access-n6rss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:04:28.936177 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:28.936149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5bbedc8d-1ead-4855-b113-dc6667de743e" (UID: "5bbedc8d-1ead-4855-b113-dc6667de743e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 22:04:29.027950 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.027910    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bbedc8d-1ead-4855-b113-dc6667de743e-tls-cert\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:04:29.027950 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.027952    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6rss\" (UniqueName: \"kubernetes.io/projected/5bbedc8d-1ead-4855-b113-dc6667de743e-kube-api-access-n6rss\") on node \"ip-10-0-138-103.ec2.internal\" DevicePath \"\""
Sep 16 22:04:29.632521 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.632485    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbedc8d-1ead-4855-b113-dc6667de743e" containerID="841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db" exitCode=0
Sep 16 22:04:29.632735 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.632540    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2"
Sep 16 22:04:29.632735 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.632571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" event={"ID":"5bbedc8d-1ead-4855-b113-dc6667de743e","Type":"ContainerDied","Data":"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"}
Sep 16 22:04:29.632735 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.632623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d9f7d764d-4j7n2" event={"ID":"5bbedc8d-1ead-4855-b113-dc6667de743e","Type":"ContainerDied","Data":"8048f9e006064d9a1d00b7fd118e6717e35c14d98076bf21dd0d1710d381ad34"}
Sep 16 22:04:29.632735 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.632644    2561 scope.go:117] "RemoveContainer" containerID="841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"
Sep 16 22:04:29.642442 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.642263    2561 scope.go:117] "RemoveContainer" containerID="841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"
Sep 16 22:04:29.642672 ip-10-0-138-103 kubenswrapper[2561]: E0916 22:04:29.642593    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db\": container with ID starting with 841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db not found: ID does not exist" containerID="841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"
Sep 16 22:04:29.642672 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.642619    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db"} err="failed to get container status \"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db\": rpc error: code = NotFound desc = could not find container \"841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db\": container with ID starting with 841fe0c30218af9126f4361f6bf3af01ec09a40d9464c8c6584dc8c6df8273db not found: ID does not exist"
Sep 16 22:04:29.652615 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.652577    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:04:29.656010 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.655991    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d9f7d764d-4j7n2"]
Sep 16 22:04:29.924741 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:04:29.924666    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bbedc8d-1ead-4855-b113-dc6667de743e" path="/var/lib/kubelet/pods/5bbedc8d-1ead-4855-b113-dc6667de743e/volumes"
Sep 16 22:09:03.949022 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:09:03.948926    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:09:03.956693 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:09:03.956667    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:09:03.959006 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:09:03.958974    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:09:03.966594 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:09:03.966573    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:14:03.977741 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:03.977643    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:14:03.984611 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:03.984588    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:14:03.989368 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:03.989349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:14:03.995742 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:03.995724    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:14:18.202243 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.202212    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sk4xn/must-gather-bddzm"]
Sep 16 22:14:18.202698 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.202545    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbedc8d-1ead-4855-b113-dc6667de743e" containerName="authorino"
Sep 16 22:14:18.202698 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.202556    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbedc8d-1ead-4855-b113-dc6667de743e" containerName="authorino"
Sep 16 22:14:18.202698 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.202632    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbedc8d-1ead-4855-b113-dc6667de743e" containerName="authorino"
Sep 16 22:14:18.205696 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.205676    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.208334 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.208315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sk4xn\"/\"default-dockercfg-tqklh\""
Sep 16 22:14:18.208435 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.208313    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"kube-root-ca.crt\""
Sep 16 22:14:18.208571 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.208554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"openshift-service-ca.crt\""
Sep 16 22:14:18.219852 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.219830    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/must-gather-bddzm"]
Sep 16 22:14:18.285006 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.284973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnj66\" (UniqueName: \"kubernetes.io/projected/c453536f-b77c-4ddf-982a-167d05cc3389-kube-api-access-fnj66\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.285198 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.285021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c453536f-b77c-4ddf-982a-167d05cc3389-must-gather-output\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.385906 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.385867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnj66\" (UniqueName: \"kubernetes.io/projected/c453536f-b77c-4ddf-982a-167d05cc3389-kube-api-access-fnj66\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.386078 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.385914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c453536f-b77c-4ddf-982a-167d05cc3389-must-gather-output\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.386257 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.386241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c453536f-b77c-4ddf-982a-167d05cc3389-must-gather-output\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.393123 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.393078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnj66\" (UniqueName: \"kubernetes.io/projected/c453536f-b77c-4ddf-982a-167d05cc3389-kube-api-access-fnj66\") pod \"must-gather-bddzm\" (UID: \"c453536f-b77c-4ddf-982a-167d05cc3389\") " pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.515277 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.515194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/must-gather-bddzm"
Sep 16 22:14:18.785660 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.785569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/must-gather-bddzm"]
Sep 16 22:14:18.787996 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:14:18.787964    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc453536f_b77c_4ddf_982a_167d05cc3389.slice/crio-b9f9a772114bcd73ab8198570288c16c7527814fdc63002c51ea051f71f33745 WatchSource:0}: Error finding container b9f9a772114bcd73ab8198570288c16c7527814fdc63002c51ea051f71f33745: Status 404 returned error can't find the container with id b9f9a772114bcd73ab8198570288c16c7527814fdc63002c51ea051f71f33745
Sep 16 22:14:18.789920 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:18.789902    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 22:14:19.301970 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:19.301935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/must-gather-bddzm" event={"ID":"c453536f-b77c-4ddf-982a-167d05cc3389","Type":"ContainerStarted","Data":"b9f9a772114bcd73ab8198570288c16c7527814fdc63002c51ea051f71f33745"}
Sep 16 22:14:20.311622 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:20.311580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/must-gather-bddzm" event={"ID":"c453536f-b77c-4ddf-982a-167d05cc3389","Type":"ContainerStarted","Data":"7ce7b46864ca05de204cfbf67864747f9faad9126f83dc8ba449aa2f33a6c2dc"}
Sep 16 22:14:20.312119 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:20.311635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/must-gather-bddzm" event={"ID":"c453536f-b77c-4ddf-982a-167d05cc3389","Type":"ContainerStarted","Data":"bf3d7f00590b16e7fd1db085d54638eb3ac735af42c1afa776df60f7fd208481"}
Sep 16 22:14:20.326555 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:20.326491    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sk4xn/must-gather-bddzm" podStartSLOduration=1.498761634 podStartE2EDuration="2.326467098s" totalImagesPullingTime="827.705464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:14:20.325133273 +0000 UTC m=+1516.877740978" watchObservedRunningTime="2026-09-16 22:14:20.326467098 +0000 UTC m=+1516.879074804"
Sep 16 22:14:21.267610 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:21.267553    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pbqpr_4cdb870e-d66f-4a12-b19a-d507d22c8655/global-pull-secret-syncer/0.log"
Sep 16 22:14:21.343392 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:21.343340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s8bzq_e9e4ee5f-57f7-4c29-bf36-5bf906f06146/konnectivity-agent/0.log"
Sep 16 22:14:21.417891 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:21.417862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-103.ec2.internal_a262ce05dc84aec0c1c985f6191b9d4d/haproxy/0.log"
Sep 16 22:14:26.192701 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:26.192593    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-62xx9_7f44f686-4ae6-41b9-b14e-9bb83478295b/kuadrant-console-plugin/0.log"
Sep 16 22:14:27.997586 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:27.997550    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-zmp2s_5a59974b-2f45-47a4-8803-7c276833507a/monitoring-plugin/0.log"
Sep 16 22:14:28.101456 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.101409    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/node-exporter/0.log"
Sep 16 22:14:28.119722 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.119691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/kube-rbac-proxy/0.log"
Sep 16 22:14:28.137937 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.137904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l9tbn_0686c2bf-5877-4270-af8e-2f1a56d9cf74/init-textfile/0.log"
Sep 16 22:14:28.340184 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.338874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/prometheus/0.log"
Sep 16 22:14:28.368951 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.368890    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/config-reloader/0.log"
Sep 16 22:14:28.391284 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.391256    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/thanos-sidecar/0.log"
Sep 16 22:14:28.413753 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.413722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/kube-rbac-proxy-web/0.log"
Sep 16 22:14:28.443454 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.443425    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/kube-rbac-proxy/0.log"
Sep 16 22:14:28.466572 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.466500    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/kube-rbac-proxy-thanos/0.log"
Sep 16 22:14:28.486398 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.486362    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4920543a-b19f-4346-94b9-32715350ab0e/init-config-reloader/0.log"
Sep 16 22:14:28.517754 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.517713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gbcsm_736791da-df14-4040-a6df-79b47f84d333/prometheus-operator/0.log"
Sep 16 22:14:28.533235 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.533197    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gbcsm_736791da-df14-4040-a6df-79b47f84d333/kube-rbac-proxy/0.log"
Sep 16 22:14:28.558510 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:28.558483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-zw2lw_02d7cd43-cf98-42e5-83cc-f826b2b206aa/prometheus-operator-admission-webhook/0.log"
Sep 16 22:14:30.877037 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:30.876988    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/2.log"
Sep 16 22:14:30.886933 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:30.886894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nl2qg_6e48c365-2533-4f3f-992b-663445e65bd9/console-operator/3.log"
Sep 16 22:14:31.385629 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.385588    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"]
Sep 16 22:14:31.393948 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.393918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.395555 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.395529    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"]
Sep 16 22:14:31.521587 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.521548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-lib-modules\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.521879 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.521846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-podres\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.522002 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.521970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwq98\" (UniqueName: \"kubernetes.io/projected/68e81f1b-d734-4052-8e38-1a250d5c6c6e-kube-api-access-hwq98\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.522154 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.522081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-sys\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.522232 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.522150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-proc\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwq98\" (UniqueName: \"kubernetes.io/projected/68e81f1b-d734-4052-8e38-1a250d5c6c6e-kube-api-access-hwq98\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-sys\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-proc\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-lib-modules\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622964    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-sys\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.622971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-podres\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.623032    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-proc\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623133 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.623080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-podres\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.623955 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.623217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e81f1b-d734-4052-8e38-1a250d5c6c6e-lib-modules\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.630642 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.630608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwq98\" (UniqueName: \"kubernetes.io/projected/68e81f1b-d734-4052-8e38-1a250d5c6c6e-kube-api-access-hwq98\") pod \"perf-node-gather-daemonset-zphnb\" (UID: \"68e81f1b-d734-4052-8e38-1a250d5c6c6e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:31.707847 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:31.707755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:32.008428 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.007089    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"]
Sep 16 22:14:32.011626 ip-10-0-138-103 kubenswrapper[2561]: W0916 22:14:32.011595    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod68e81f1b_d734_4052_8e38_1a250d5c6c6e.slice/crio-10d4038e3f158eac2b0825e2f10bd4852f9e566c2c44596df4c81fdda48eb799 WatchSource:0}: Error finding container 10d4038e3f158eac2b0825e2f10bd4852f9e566c2c44596df4c81fdda48eb799: Status 404 returned error can't find the container with id 10d4038e3f158eac2b0825e2f10bd4852f9e566c2c44596df4c81fdda48eb799
Sep 16 22:14:32.159008 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.158978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-jqpnk_fdcf1b13-0a17-423a-9768-211450403daa/volume-data-source-validator/0.log"
Sep 16 22:14:32.398356 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.397872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb" event={"ID":"68e81f1b-d734-4052-8e38-1a250d5c6c6e","Type":"ContainerStarted","Data":"372fd3f1a39f846796e6c440e5df1a147a00900054175d602b59aeab94d2ca16"}
Sep 16 22:14:32.398356 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.397938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb" event={"ID":"68e81f1b-d734-4052-8e38-1a250d5c6c6e","Type":"ContainerStarted","Data":"10d4038e3f158eac2b0825e2f10bd4852f9e566c2c44596df4c81fdda48eb799"}
Sep 16 22:14:32.398356 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.397992    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:32.417077 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:32.417021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb" podStartSLOduration=1.4170029180000001 podStartE2EDuration="1.417002918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 22:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:14:32.414625434 +0000 UTC m=+1528.967233140" watchObservedRunningTime="2026-09-16 22:14:32.417002918 +0000 UTC m=+1528.969610621"
Sep 16 22:14:33.211957 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:33.211929    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsnmt_92df0d08-c192-4d3e-a313-3c45be57210e/dns/0.log"
Sep 16 22:14:33.232130 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:33.232088    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsnmt_92df0d08-c192-4d3e-a313-3c45be57210e/kube-rbac-proxy/0.log"
Sep 16 22:14:33.335301 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:33.335270    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zl58p_c0731d0a-d92c-4743-8649-109d1c45ae24/dns-node-resolver/0.log"
Sep 16 22:14:33.868888 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:33.868847    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92dsx_d3345e2c-98f0-4e97-b46c-bf0d4bc503f0/node-ca/0.log"
Sep 16 22:14:34.874542 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:34.874512    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-4bdgf_3e5e0072-7764-40d9-b2ad-31aa849583fc/kube-auth-proxy/0.log"
Sep 16 22:14:35.055660 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:35.055630    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5fb467cd-qxv9d_24898bab-eb30-4e8c-ba37-ca86bfcfb56b/router/0.log"
Sep 16 22:14:35.677932 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:35.677904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2glq_42f360e7-fbf8-483b-8df4-27fc1b21fdc8/serve-healthcheck-canary/0.log"
Sep 16 22:14:36.195902 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:36.195865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-d9xq5_68f68988-945c-499f-bfe8-cff969e494a4/insights-operator/0.log"
Sep 16 22:14:36.197093 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:36.197072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-d9xq5_68f68988-945c-499f-bfe8-cff969e494a4/insights-operator/1.log"
Sep 16 22:14:36.275980 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:36.275949    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcd54_1b65400e-ae1a-4a8c-a074-54e628e4acf8/kube-rbac-proxy/0.log"
Sep 16 22:14:36.294335 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:36.294301    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcd54_1b65400e-ae1a-4a8c-a074-54e628e4acf8/exporter/0.log"
Sep 16 22:14:36.313800 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:36.313764    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcd54_1b65400e-ae1a-4a8c-a074-54e628e4acf8/extractor/0.log"
Sep 16 22:14:38.416731 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:38.416702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-zphnb"
Sep 16 22:14:38.760172 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:38.760057    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-p4qmz_f91e1e6f-bcbb-40dd-a876-a26ec7acfebd/manager/0.log"
Sep 16 22:14:38.779266 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:38.779239    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-p4qmz_f91e1e6f-bcbb-40dd-a876-a26ec7acfebd/copy-manifests/0.log"
Sep 16 22:14:40.016252 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:40.016222    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68dbcd7456-qgnpq_ec09c467-2072-4f5e-a1be-53d27b53569d/manager/0.log"
Sep 16 22:14:41.994214 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:41.994179    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-4bdgf_3e5e0072-7764-40d9-b2ad-31aa849583fc/kube-auth-proxy/0.log"
Sep 16 22:14:42.075044 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:42.075011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5fb467cd-qxv9d_24898bab-eb30-4e8c-ba37-ca86bfcfb56b/router/0.log"
Sep 16 22:14:43.376373 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:43.376347    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-4bdgf_3e5e0072-7764-40d9-b2ad-31aa849583fc/kube-auth-proxy/0.log"
Sep 16 22:14:43.454506 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:43.454471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5fb467cd-qxv9d_24898bab-eb30-4e8c-ba37-ca86bfcfb56b/router/0.log"
Sep 16 22:14:45.425821 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:45.425784    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vnmw7_7e87bdec-f51b-4aa4-945c-d5de70e4b0a6/migrator/0.log"
Sep 16 22:14:45.443718 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:45.443622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vnmw7_7e87bdec-f51b-4aa4-945c-d5de70e4b0a6/graceful-termination/0.log"
Sep 16 22:14:47.005269 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.005244    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/kube-multus-additional-cni-plugins/0.log"
Sep 16 22:14:47.022502 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.022474    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/egress-router-binary-copy/0.log"
Sep 16 22:14:47.042719 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.042693    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/cni-plugins/0.log"
Sep 16 22:14:47.061467 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.061442    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/bond-cni-plugin/0.log"
Sep 16 22:14:47.078871 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.078844    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/routeoverride-cni/0.log"
Sep 16 22:14:47.096524 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.096495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/whereabouts-cni-bincopy/0.log"
Sep 16 22:14:47.114282 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.114254    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbsql_fe5e59df-6fbf-4665-b8e8-47c0de3b111b/whereabouts-cni/0.log"
Sep 16 22:14:47.149517 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.149485    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gr9rk_3dacb361-b3f4-495a-ad72-22e0ae551849/kube-multus/0.log"
Sep 16 22:14:47.241014 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.240980    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cggth_0d183d5e-2171-44ed-b326-0d80cc7897db/network-metrics-daemon/0.log"
Sep 16 22:14:47.257567 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:47.257498    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cggth_0d183d5e-2171-44ed-b326-0d80cc7897db/kube-rbac-proxy/0.log"
Sep 16 22:14:48.141492 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.141457    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-controller/0.log"
Sep 16 22:14:48.156364 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.156338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/0.log"
Sep 16 22:14:48.156527 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.156338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovn-acl-logging/1.log"
Sep 16 22:14:48.181896 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.181874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/kube-rbac-proxy-node/0.log"
Sep 16 22:14:48.204315 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.204288    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/kube-rbac-proxy-ovn-metrics/0.log"
Sep 16 22:14:48.218955 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.218936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/northd/0.log"
Sep 16 22:14:48.237252 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.237229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/nbdb/0.log"
Sep 16 22:14:48.255136 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.255113    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/sbdb/0.log"
Sep 16 22:14:48.307738 ip-10-0-138-103 kubenswrapper[2561]: I0916 22:14:48.307709    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b4lcb_57ba7e57-837a-4474-ba76-e051a733d6cf/ovnkube-controller/0.log"