Jun 09 14:58:15.062841 ip-10-0-133-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 14:58:15.062851 ip-10-0-133-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 14:58:15.062859 ip-10-0-133-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 14:58:15.063024 ip-10-0-133-102 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 14:58:25.294927 ip-10-0-133-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 14:58:25.294946 ip-10-0-133-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab0c8af48b1c46c68cc7769b40484f1f -- Jun 09 15:00:53.245511 ip-10-0-133-102 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:00:53.677001 ip-10-0-133-102 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:00:53.677001 ip-10-0-133-102 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:00:53.677001 ip-10-0-133-102 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:00:53.677001 ip-10-0-133-102 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:00:53.677001 ip-10-0-133-102 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:00:53.679283 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.679187 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:00:53.684204 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.684204 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684204 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.684204 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684208 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684211 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684214 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684217 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684220 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684222 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684225 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684228 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684232 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684235 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684238 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684241 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684243 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684246 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684249 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684251 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684254 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684256 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684259 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.684310 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684268 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684271 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684273 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684276 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684278 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684282 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684285 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684288 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684291 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684293 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684296 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684298 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684301 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684304 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684307 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684311 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684314 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684316 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684319 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684321 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.684765 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684324 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684327 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684330 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684332 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684337 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684341 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684344 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684347 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684350 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684352 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684356 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684359 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684362 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684365 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684367 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684370 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684372 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684378 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684381 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.685291 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684383 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684386 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684388 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684391 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684394 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684398 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684401 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684404 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684406 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684410 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684414 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684417 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684420 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684423 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684425 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684428 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684430 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684433 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684435 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.685781 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684438 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684440 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684443 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684448 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684450 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684453 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684456 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684458 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684461 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684464 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684466 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684469 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684471 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684474 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684476 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684479 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684482 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.684484 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685916 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.686252 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685924 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685927 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685930 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685933 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685936 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685939 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685941 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685944 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685946 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685949 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685952 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685954 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685957 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685959 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685963 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685966 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685968 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685971 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685973 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685976 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.686748 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685980 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685983 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685986 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685989 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685992 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685994 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.685997 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686000 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686002 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686005 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686009 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686013 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686017 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686019 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686022 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686025 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686027 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686030 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686033 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.687365 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686035 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686038 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686040 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686043 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686045 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686048 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686050 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686053 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686056 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686058 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686061 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686063 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686066 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686069 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686072 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686075 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686079 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686083 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686086 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.687835 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686088 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686091 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686094 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686096 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686099 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686102 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686104 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686106 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686109 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686111 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686114 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686116 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686119 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686121 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686124 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686127 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686130 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686132 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686135 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686137 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.688321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686141 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686144 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686146 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686149 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686152 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686154 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686157 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686174 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686177 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686180 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686184 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686187 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686190 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686192 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686195 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686198 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686200 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686204 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686207 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686210 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.688842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686608 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686613 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686615 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686619 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686623 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686626 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686629 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686631 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686634 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686638 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686642 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686644 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686648 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686651 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686655 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686658 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686662 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686665 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686668 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.689356 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686671 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686674 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686677 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686680 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686683 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686685 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686688 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686691 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686693 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686696 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686699 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686701 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686704 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686706 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686709 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686711 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686714 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686716 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686719 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686721 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.689842 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686724 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686726 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686730 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686732 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686735 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686738 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686740 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686743 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686745 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686748 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686750 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686753 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686755 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686758 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686762 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686765 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686767 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686770 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686772 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686775 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.690378 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686777 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686780 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686782 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686785 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686787 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686790 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686792 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686795 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686797 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686800 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686802 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686805 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686807 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686810 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686812 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686815 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686817 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686820 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686823 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686825 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.690868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686828 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686832 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686835 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686837 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686840 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686843 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686849 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686852 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686854 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686857 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686859 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686862 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686865 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686867 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686870 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686873 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686876 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686878 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.686881 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.691393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.686974 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.686990 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.686998 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687002 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687006 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687009 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687014 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687018 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687021 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687024 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687028 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687031 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687035 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687038 2563 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687041 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687044 2563 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687047 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687050 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687054 2563 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687057 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687061 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687064 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687068 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687076 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:00:53.691899 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687079 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687083 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687086 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687090 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687093 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687096 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687099 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687102 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687106 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687109 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687114 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687117 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687120 2563 flags.go:64] FLAG: --enable-server="true" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687123 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687128 2563 flags.go:64] FLAG: --event-burst="100" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687131 2563 flags.go:64] FLAG: --event-qps="50" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687134 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687137 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687140 2563 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687144 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687147 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687150 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687153 2563 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687156 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687173 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:00:53.692488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687176 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687179 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687183 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687186 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687190 2563 flags.go:64] FLAG: --feature-gates="" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687194 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687198 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687201 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687204 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687207 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687210 2563 flags.go:64] FLAG: --help="false" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687213 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687216 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687219 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687222 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687226 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687229 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687234 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687237 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687240 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687242 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687246 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687249 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687252 2563 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:00:53.693136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687254 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687257 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687261 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687263 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687266 2563 flags.go:64] FLAG: --lock-file="" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687269 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687272 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687275 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687280 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687283 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687286 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687289 2563 flags.go:64] FLAG: --logging-format="text" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687292 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687296 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687300 2563 flags.go:64] FLAG: --manifest-url="" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687303 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687308 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687311 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687315 2563 flags.go:64] FLAG: --max-pods="110" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687318 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687321 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687324 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687326 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687330 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687333 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:00:53.693780 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687337 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687344 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687347 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687351 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687354 2563 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687357 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687362 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687365 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687368 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687371 2563 flags.go:64] FLAG: --port="10250" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687374 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687377 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083853a4c20bdde87" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687381 2563 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687384 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687387 2563 flags.go:64] FLAG: --register-node="true" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687390 2563 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687394 2563 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687397 2563 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687400 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687403 2563 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687406 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687410 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687414 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687418 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687421 2563 flags.go:64] FLAG: --runonce="false" Jun 09 15:00:53.694770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687423 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687426 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687429 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687433 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687436 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687438 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687442 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687446 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687449 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687452 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687454 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687457 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687460 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687463 2563 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687466 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687472 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687474 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687477 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687481 2563 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687484 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687486 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687489 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687492 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687495 2563 flags.go:64] FLAG: --v="2" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687499 2563 flags.go:64] FLAG: --version="false" Jun 09 15:00:53.695774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687503 2563 flags.go:64] FLAG: --vmodule="" Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687507 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.687510 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687626 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687632 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687635 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687638 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687640 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687643 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687646 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687650 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687654 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687656 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687659 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687662 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687664 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687667 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687669 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687672 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687674 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.696868 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687677 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687680 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687682 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687685 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687687 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687690 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687692 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687695 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687697 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687700 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687703 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687705 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687708 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687712 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687714 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687717 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687722 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687725 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687728 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.697796 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687731 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687733 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687736 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687738 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687741 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687744 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687746 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687749 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687751 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687754 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687756 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687759 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687761 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687764 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687766 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687769 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687771 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687774 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687777 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687779 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.698626 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687782 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687785 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687787 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687790 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687792 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687795 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687797 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687800 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687802 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687808 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687810 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687814 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687816 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687820 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687824 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687827 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687829 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687832 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687835 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.699266 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687838 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687841 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687843 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687847 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687851 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687854 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687857 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687859 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687862 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687865 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687867 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687870 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687872 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687875 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687877 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687880 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687883 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687885 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687888 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.699906 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687890 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687893 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687895 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687900 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.687903 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.688552 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.697043 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.697065 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.697085 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.697094 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697199 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697209 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697215 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697220 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697225 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.700506 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697229 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697234 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697239 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697243 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697248 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697252 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697256 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697261 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697265 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697270 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697274 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697280 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697284 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697289 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697293 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697297 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697302 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697306 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697310 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.700908 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697315 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697319 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697324 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697328 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697333 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697338 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697343 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697347 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697352 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697356 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697361 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697367 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697373 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697378 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697383 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697388 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697393 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697398 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697405 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.701706 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697410 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697416 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697420 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697426 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697431 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697436 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697441 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697446 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697450 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697457 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697463 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697467 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697472 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697476 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697480 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697485 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697489 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697493 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697499 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697503 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.702329 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697508 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697513 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697517 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697521 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697525 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697530 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697534 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697539 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697543 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697547 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697551 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697556 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697560 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697564 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697568 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697572 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697577 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697582 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697587 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697591 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.702969 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697595 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697600 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697604 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697608 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697612 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697616 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697621 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697625 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697629 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697633 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697638 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697643 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697647 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697651 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697656 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.703520 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697660 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.697668 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697862 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697871 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697875 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697881 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697886 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697890 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697895 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697899 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697904 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697908 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697912 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697916 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697922 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:00:53.703893 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697926 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697930 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697935 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697939 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697943 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697947 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697951 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697956 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697960 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697965 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697969 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697973 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697977 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697982 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697986 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697991 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697995 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.697999 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698004 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698008 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:00:53.704340 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698012 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698017 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698021 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698025 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698029 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698033 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698037 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698041 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698046 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698052 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698058 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698062 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698068 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698072 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698076 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698080 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698084 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698088 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698093 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:00:53.704861 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698097 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698102 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698106 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698110 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698116 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698122 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698127 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698132 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698137 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698141 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698146 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698150 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698154 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698174 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698179 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698183 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698188 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698192 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698197 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:00:53.705414 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698201 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698206 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698210 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698214 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698219 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698223 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698227 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698233 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698238 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698242 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698246 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698251 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698255 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698259 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698266 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698272 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698276 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698281 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698286 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:00:53.705881 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698291 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698296 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698301 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698306 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698312 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698316 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698321 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698325 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:53.698329 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.698337 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.698516 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.702592 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.704013 2563 server.go:1019] "Starting client certificate rotation" Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.704112 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:00:53.706389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.704146 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:00:53.707373 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.707356 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:00:53.713388 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.713361 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:00:53.724513 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.724483 2563 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:00:53.728176 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.728131 2563 log.go:25] "Validated CRI v1 image API" Jun 09 15:00:53.729254 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.729235 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:00:53.732134 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.732105 2563 fs.go:135] Filesystem UUIDs: map[760d6118-f0da-4f65-95eb-e35503262470:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8ced407a-09c5-456c-9f5e-feb65319205d:/dev/nvme0n1p3] Jun 09 15:00:53.732221 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.732136 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:00:53.738248 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.738222 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:00:53.738481 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.738370 2563 manager.go:216] Machine: {Timestamp:2026-06-09 15:00:53.736935833 +0000 UTC m=+0.367139064 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103179 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2272afdb2daf30eabe6665638b56d2 SystemUUID:ec2272af-db2d-af30-eabe-6665638b56d2 BootID:ab0c8af4-8b1c-46c6-8cc7-769b40484f1f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:e7:d7:6a:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:e7:d7:6a:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:e4:88:9b:d9:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:00:53.738543 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.738481 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:00:53.738600 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.738588 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:00:53.742269 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.742231 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:00:53.742454 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.742273 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:00:53.743550 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.743535 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:00:53.743618 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.743558 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:00:53.743618 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.743569 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:00:53.744054 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.744042 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:00:53.744748 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.744735 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:00:53.747699 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747678 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:00:53.747913 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747901 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:00:53.747989 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747944 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:00:53.747989 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747962 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:00:53.747989 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747978 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:00:53.748107 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.747992 2563 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:00:53.748107 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.748008 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:00:53.748488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.748467 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:00:53.748574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.748493 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:00:53.751032 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.751003 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:00:53.752469 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.752455 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:00:53.752526 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.752487 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:00:53.753537 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753525 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:00:53.753574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753542 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:00:53.753574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753549 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:00:53.753574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753557 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753577 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753584 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753592 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753600 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753610 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753615 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753624 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:00:53.753660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.753629 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:00:53.755757 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.755744 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:00:53.755757 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.755757 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:00:53.758863 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.758838 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:00:53.758863 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.758845 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:00:53.758863 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.758854 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:00:53.759506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.759491 2563 server.go:1268] "Started kubelet" Jun 09 15:00:53.759635 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.759587 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:00:53.760084 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.760021 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:00:53.760201 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.760109 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:00:53.760625 ip-10-0-133-102 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:00:53.761727 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.761714 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:00:53.761799 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.761779 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:00:53.766619 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.766594 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:00:53.766619 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.766595 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:00:53.767234 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.767198 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:53.767234 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.767231 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:00:53.767376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.767255 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:00:53.767376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.767328 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:00:53.767376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.767333 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:00:53.767376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.767347 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:00:53.770560 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770436 2563 factory.go:55] Registering systemd factory Jun 09 15:00:53.770560 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770458 2563 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:00:53.770768 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770751 2563 factory.go:153] Registering CRI-O factory Jun 09 15:00:53.770830 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770773 2563 factory.go:223] Registration of the crio container factory successfully Jun 09 15:00:53.770886 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770832 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:00:53.770886 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770859 2563 factory.go:103] Registering Raw factory Jun 09 15:00:53.770886 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.770886 2563 manager.go:1196] Started watching for new ooms in manager Jun 09 15:00:53.771298 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.771271 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:00:53.771667 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.771649 2563 manager.go:349] Starting recovery of all containers Jun 09 15:00:53.776018 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.775985 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 15:00:53.776149 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.776071 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 15:00:53.777122 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.776071 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-102.ec2.internal.18b771c18d2c9bf6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-102.ec2.internal,UID:ip-10-0-133-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-102.ec2.internal,},FirstTimestamp:2026-06-09 15:00:53.759458294 +0000 UTC m=+0.389661525,LastTimestamp:2026-06-09 15:00:53.759458294 +0000 UTC m=+0.389661525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-102.ec2.internal,}" Jun 09 15:00:53.783138 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.783117 2563 manager.go:354] Recovery completed Jun 09 15:00:53.783350 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.783330 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fjlp" Jun 09 15:00:53.787850 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.787837 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.790415 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.790234 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.790459 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.790448 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.790498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.790465 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.790852 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.790828 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fjlp" Jun 09 15:00:53.791216 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.791201 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:00:53.791216 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.791216 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:00:53.791337 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.791220 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.791337 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.791234 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:00:53.792140 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792119 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.792250 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792152 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.792250 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792184 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.792328 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.792247 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-102.ec2.internal.18b771c18f050d72 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-102.ec2.internal,UID:ip-10-0-133-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-102.ec2.internal,},FirstTimestamp:2026-06-09 15:00:53.790420338 +0000 UTC m=+0.420623574,LastTimestamp:2026-06-09 15:00:53.790420338 +0000 UTC m=+0.420623574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-102.ec2.internal,}" Jun 09 15:00:53.792794 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792783 2563 policy_none.go:49] "None policy: Start" Jun 09 15:00:53.792843 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792801 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:00:53.792843 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.792815 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:00:53.793865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.793853 2563 policy_none.go:47] "Start" Jun 09 15:00:53.829931 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.829908 2563 manager.go:337] "Starting Device Plugin manager" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.829956 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.829967 2563 server.go:87] "Starting device plugin registration server" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.830265 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.830283 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.830483 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.830563 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.830572 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.831270 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.831330 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:53.835753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.834867 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:00:53.836171 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.836140 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:00:53.836233 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.836200 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:00:53.836233 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.836229 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:00:53.836332 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.836269 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:00:53.838149 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.838130 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:00:53.931217 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.931097 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.932192 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.932152 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.932317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.932206 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.932317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.932221 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.932317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.932265 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.937265 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.937237 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal"] Jun 09 15:00:53.937322 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.937314 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.938107 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.938089 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.938174 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.938124 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.938174 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.938138 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.939441 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.939427 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.939543 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.939527 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.939586 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.939559 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.940139 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940121 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.940271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940153 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.940271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940121 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.940271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940182 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.940271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940202 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.940271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.940213 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.942583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.941806 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.942583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.941843 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:00:53.942997 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.942979 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:00:53.943070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.943013 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:00:53.943070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.943036 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:00:53.944436 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.944416 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.944509 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.944438 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-102.ec2.internal\": node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:53.962880 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.962850 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-102.ec2.internal\" not found" node="ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.966505 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.966484 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-102.ec2.internal\" not found" node="ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.968495 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.968476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2f90cf2738dff4fcdeb8e9438957c52-config\") pod \"kube-apiserver-proxy-ip-10-0-133-102.ec2.internal\" (UID: \"e2f90cf2738dff4fcdeb8e9438957c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.968580 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.968500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.968580 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:53.968521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:53.968659 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:53.968617 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.069643 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.069607 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.069643 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2f90cf2738dff4fcdeb8e9438957c52-config\") pod \"kube-apiserver-proxy-ip-10-0-133-102.ec2.internal\" (UID: \"e2f90cf2738dff4fcdeb8e9438957c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.069866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.069866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.069866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.069866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2f90cf2738dff4fcdeb8e9438957c52-config\") pod \"kube-apiserver-proxy-ip-10-0-133-102.ec2.internal\" (UID: \"e2f90cf2738dff4fcdeb8e9438957c52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.069866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.069793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f57b34bdcc2b7cf25aa820f4d27a7f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal\" (UID: \"9f57b34bdcc2b7cf25aa820f4d27a7f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.169994 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.169953 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.266465 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.266411 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.270722 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.270509 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.270722 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.270567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.371574 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.371530 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.471962 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.471922 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.572418 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.572336 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.672773 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.672737 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.703920 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.703893 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:00:54.704478 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.704056 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:00:54.741273 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.741239 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:00:54.752822 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:54.752790 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f90cf2738dff4fcdeb8e9438957c52.slice/crio-a45c8b05fb4f2eb64e2b9512b1791afcd339081b6c0c97450a7bd15eb4cc3ed2 WatchSource:0}: Error finding container a45c8b05fb4f2eb64e2b9512b1791afcd339081b6c0c97450a7bd15eb4cc3ed2: Status 404 returned error can't find the container with id a45c8b05fb4f2eb64e2b9512b1791afcd339081b6c0c97450a7bd15eb4cc3ed2 Jun 09 15:00:54.753328 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:54.753305 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f57b34bdcc2b7cf25aa820f4d27a7f6.slice/crio-4bc6f56a636960e67147cf64f615625a13791823437a9ed237e6ff220dc47e88 WatchSource:0}: Error finding container 4bc6f56a636960e67147cf64f615625a13791823437a9ed237e6ff220dc47e88: Status 404 returned error can't find the container with id 4bc6f56a636960e67147cf64f615625a13791823437a9ed237e6ff220dc47e88 Jun 09 15:00:54.758572 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.758554 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:00:54.772904 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:54.772861 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-102.ec2.internal\" not found" Jun 09 15:00:54.794620 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.794570 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:55:53 +0000 UTC" deadline="2027-12-20 20:00:54.498293563 +0000 UTC" Jun 09 15:00:54.794620 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.794617 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13420h59m59.703679839s" Jun 09 15:00:54.833525 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.833451 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:00:54.839928 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.839879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" event={"ID":"e2f90cf2738dff4fcdeb8e9438957c52","Type":"ContainerStarted","Data":"a45c8b05fb4f2eb64e2b9512b1791afcd339081b6c0c97450a7bd15eb4cc3ed2"} Jun 09 15:00:54.840893 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.840870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" event={"ID":"9f57b34bdcc2b7cf25aa820f4d27a7f6","Type":"ContainerStarted","Data":"4bc6f56a636960e67147cf64f615625a13791823437a9ed237e6ff220dc47e88"} Jun 09 15:00:54.868143 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.868111 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.883694 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.883674 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:00:54.884913 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.884898 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" Jun 09 15:00:54.892632 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:54.892612 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:00:55.157067 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.157039 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:00:55.578709 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.578627 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:00:55.748479 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.748449 2563 apiserver.go:52] "Watching apiserver" Jun 09 15:00:55.755426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.755397 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:00:55.755875 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.755854 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zq96d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x","openshift-cluster-node-tuning-operator/tuned-rwnqh","openshift-image-registry/node-ca-n4lzw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-cx58x","openshift-multus/network-metrics-daemon-vnw84","kube-system/global-pull-secret-syncer-wcw9w","kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal","openshift-dns/node-resolver-xrdfn","openshift-multus/multus-7s62s","openshift-network-diagnostics/network-check-target-mt8k5","openshift-network-operator/iptables-alerter-c2hl2","openshift-ovn-kubernetes/ovnkube-node-59d86"] Jun 09 15:00:55.757264 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.757241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.758262 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.758240 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.758367 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.758317 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:00:55.759287 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.759265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.760123 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.760103 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4f7dj\"" Jun 09 15:00:55.760239 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.760173 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:00:55.760298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.760243 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.760354 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.760175 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:00:55.761693 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.761495 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.762392 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.762369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:00:55.763516 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.762825 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.763516 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.762942 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.764264 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.763782 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrqdw\"" Jun 09 15:00:55.764264 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.763898 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.764264 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.764063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.764264 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.764064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2wbwn\"" Jun 09 15:00:55.765571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.764763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.765571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.765370 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.765713 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.765605 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:00:55.766640 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.766620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.766724 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.766703 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:00:55.767055 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.766879 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:00:55.767211 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.767193 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:00:55.767374 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.767350 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:00:55.767454 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.767435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.767616 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.767599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xshf\"" Jun 09 15:00:55.768002 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.767984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.768464 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.768446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:00:55.768579 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.768499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bkg26\"" Jun 09 15:00:55.768737 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.768718 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.769251 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.769227 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.769450 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.769250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.770216 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.770197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wqqlj\"" Jun 09 15:00:55.770344 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.770305 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.770459 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.770443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:55.770545 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.770506 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:00:55.770628 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.770607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.771462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.771446 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:00:55.771804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.771784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.772406 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.772386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l4vdm\"" Jun 09 15:00:55.773150 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.773131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.774321 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.774153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:00:55.774321 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.774180 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fx2fm\"" Jun 09 15:00:55.774321 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.774156 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.774520 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.774448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.776401 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.776341 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:00:55.776614 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.776594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:00:55.776678 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.776616 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:00:55.776886 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.776864 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:00:55.776973 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.776904 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:00:55.777404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777384 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:00:55.777498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777414 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5csn5\"" Jun 09 15:00:55.777498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-kubelet-config\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.777498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.777498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-cnibin\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.777665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhs5b\" (UniqueName: \"kubernetes.io/projected/dd337ebb-9c52-4890-adb4-0645c3b2b784-kube-api-access-lhs5b\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.777665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysconfig\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.777665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-lib-modules\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.777665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-system-cni-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.777665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d8f273-7739-4604-ab6e-40586464a82c-konnectivity-ca\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-var-lib-kubelet\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-tmp\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-etc-selinux\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cncml\" (UniqueName: \"kubernetes.io/projected/8ee049a3-ac31-42dd-aec3-ae7044f01c66-kube-api-access-cncml\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-systemd\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd337ebb-9c52-4890-adb4-0645c3b2b784-serviceca\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.777906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-run\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-host\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.777953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghkx\" (UniqueName: \"kubernetes.io/projected/96d6550e-0be0-4b01-bac3-dac2924a6f04-kube-api-access-cghkx\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-registration-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-sys-fs\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-sys\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-os-release\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778143 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lljd\" (UniqueName: \"kubernetes.io/projected/d5361ddb-922a-43cc-90bf-8543dc502c35-kube-api-access-5lljd\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ee049a3-ac31-42dd-aec3-ae7044f01c66-hosts-file\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee049a3-ac31-42dd-aec3-ae7044f01c66-tmp-dir\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.778285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d8f273-7739-4604-ab6e-40586464a82c-agent-certs\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-modprobe-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-kubernetes\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-dbus\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-socket-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclnw\" (UniqueName: \"kubernetes.io/projected/e590afa8-41e6-43a9-9a78-9af443714ed8-kube-api-access-gclnw\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bws5t\" (UniqueName: \"kubernetes.io/projected/5928f80d-3ea5-473c-a23c-a1f463713d20-kube-api-access-bws5t\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-device-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd337ebb-9c52-4890-adb4-0645c3b2b784-host\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-conf\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.778885 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.778664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-tuned\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.811309 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.811286 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-snv92" Jun 09 15:00:55.819850 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.819831 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-snv92" Jun 09 15:00:55.868907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.868826 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:00:55.879719 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bws5t\" (UniqueName: \"kubernetes.io/projected/5928f80d-3ea5-473c-a23c-a1f463713d20-kube-api-access-bws5t\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.879865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.879865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-device-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.879865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-device-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.879865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd337ebb-9c52-4890-adb4-0645c3b2b784-host\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.879865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd337ebb-9c52-4890-adb4-0645c3b2b784-host\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-conf\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-tuned\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.879896 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-node-log\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.879962 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:56.379940756 +0000 UTC m=+3.010143977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.879988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-netd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-socket-dir-parent\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.880049 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:55.880060 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhs5b\" (UniqueName: \"kubernetes.io/projected/dd337ebb-9c52-4890-adb4-0645c3b2b784-kube-api-access-lhs5b\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-conf\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysconfig\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.880124 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:56.380103355 +0000 UTC m=+3.010306587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-lib-modules\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysconfig\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-config\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-var-lib-kubelet\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-etc-selinux\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-lib-modules\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880291 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880301 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-var-lib-kubelet\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cncml\" (UniqueName: \"kubernetes.io/projected/8ee049a3-ac31-42dd-aec3-ae7044f01c66-kube-api-access-cncml\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-host-slash\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-k8s-cni-cncf-io\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-etc-selinux\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-kubelet\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.880617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-systemd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd337ebb-9c52-4890-adb4-0645c3b2b784-serviceca\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-run\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghkx\" (UniqueName: \"kubernetes.io/projected/96d6550e-0be0-4b01-bac3-dac2924a6f04-kube-api-access-cghkx\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-run\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-registration-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-netns\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee049a3-ac31-42dd-aec3-ae7044f01c66-tmp-dir\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-registration-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-log-socket\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovn-node-metrics-cert\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-script-lib\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-cni-binary-copy\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-multus\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.881423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-slash\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-modprobe-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd337ebb-9c52-4890-adb4-0645c3b2b784-serviceca\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-socket-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.880994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclnw\" (UniqueName: \"kubernetes.io/projected/e590afa8-41e6-43a9-9a78-9af443714ed8-kube-api-access-gclnw\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ee049a3-ac31-42dd-aec3-ae7044f01c66-tmp-dir\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-modprobe-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhdr\" (UniqueName: \"kubernetes.io/projected/ffe0f964-c61c-4922-96f8-9b0977da64c8-kube-api-access-lzhdr\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-socket-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-systemd-units\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-env-overrides\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbp2j\" (UniqueName: \"kubernetes.io/projected/c5081652-1310-458a-9462-521d0ccb4ec4-kube-api-access-rbp2j\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-system-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-kubelet-config\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-cnibin\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.882243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-system-cni-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-etc-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-kubelet-config\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-system-cni-dir\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-cnibin\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d8f273-7739-4604-ab6e-40586464a82c-konnectivity-ca\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-tmp\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-iptables-alerter-script\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-os-release\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-systemd\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-host\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-sys-fs\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-netns\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-systemd\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-hostroot\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.883049 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-conf-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e590afa8-41e6-43a9-9a78-9af443714ed8-sys-fs\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-sys\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-os-release\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-sys\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5361ddb-922a-43cc-90bf-8543dc502c35-os-release\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d8f273-7739-4604-ab6e-40586464a82c-konnectivity-ca\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lljd\" (UniqueName: \"kubernetes.io/projected/d5361ddb-922a-43cc-90bf-8543dc502c35-kube-api-access-5lljd\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ee049a3-ac31-42dd-aec3-ae7044f01c66-hosts-file\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.881997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-ovn\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-etc-kubernetes\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-var-lib-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d8f273-7739-4604-ab6e-40586464a82c-agent-certs\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-kubernetes\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-host\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ee049a3-ac31-42dd-aec3-ae7044f01c66-hosts-file\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-kubernetes\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-dbus\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-sysctl-d\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26nn\" (UniqueName: \"kubernetes.io/projected/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-kube-api-access-h26nn\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-bin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf3cd76b-1e7e-4707-8764-fc7e2c806921-dbus\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-bin\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-cnibin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882600 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-kubelet\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-multus-daemon-config\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-multus-certs\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.884944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.882971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5361ddb-922a-43cc-90bf-8543dc502c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.885761 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.883812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-etc-tuned\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.885761 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.884234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5928f80d-3ea5-473c-a23c-a1f463713d20-tmp\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.885761 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.885038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d8f273-7739-4604-ab6e-40586464a82c-agent-certs\") pod \"konnectivity-agent-zq96d\" (UID: \"c1d8f273-7739-4604-ab6e-40586464a82c\") " pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:55.888871 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.888843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cncml\" (UniqueName: \"kubernetes.io/projected/8ee049a3-ac31-42dd-aec3-ae7044f01c66-kube-api-access-cncml\") pod \"node-resolver-xrdfn\" (UID: \"8ee049a3-ac31-42dd-aec3-ae7044f01c66\") " pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:55.888981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.888916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bws5t\" (UniqueName: \"kubernetes.io/projected/5928f80d-3ea5-473c-a23c-a1f463713d20-kube-api-access-bws5t\") pod \"tuned-rwnqh\" (UID: \"5928f80d-3ea5-473c-a23c-a1f463713d20\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:55.889305 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.889274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhs5b\" (UniqueName: \"kubernetes.io/projected/dd337ebb-9c52-4890-adb4-0645c3b2b784-kube-api-access-lhs5b\") pod \"node-ca-n4lzw\" (UID: \"dd337ebb-9c52-4890-adb4-0645c3b2b784\") " pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:55.889914 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.889893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghkx\" (UniqueName: \"kubernetes.io/projected/96d6550e-0be0-4b01-bac3-dac2924a6f04-kube-api-access-cghkx\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:55.890023 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.890009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lljd\" (UniqueName: \"kubernetes.io/projected/d5361ddb-922a-43cc-90bf-8543dc502c35-kube-api-access-5lljd\") pod \"multus-additional-cni-plugins-cx58x\" (UID: \"d5361ddb-922a-43cc-90bf-8543dc502c35\") " pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:55.890487 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.890468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclnw\" (UniqueName: \"kubernetes.io/projected/e590afa8-41e6-43a9-9a78-9af443714ed8-kube-api-access-gclnw\") pod \"aws-ebs-csi-driver-node-9vf9x\" (UID: \"e590afa8-41e6-43a9-9a78-9af443714ed8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:55.983143 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-system-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-etc-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-iptables-alerter-script\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-os-release\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-system-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-netns\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-netns\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-hostroot\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-conf-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-etc-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-ovn\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-ovn\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-etc-kubernetes\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-var-lib-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26nn\" (UniqueName: \"kubernetes.io/projected/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-kube-api-access-h26nn\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-bin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-bin\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-cnibin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-kubelet\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-multus-daemon-config\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-multus-certs\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-node-log\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-netd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.983790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-socket-dir-parent\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-config\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-host-slash\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-k8s-cni-cncf-io\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-kubelet\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-systemd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-netns\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-log-socket\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovn-node-metrics-cert\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-script-lib\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-cni-binary-copy\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-multus\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-slash\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhdr\" (UniqueName: \"kubernetes.io/projected/ffe0f964-c61c-4922-96f8-9b0977da64c8-kube-api-access-lzhdr\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.984490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-systemd-units\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-env-overrides\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbp2j\" (UniqueName: \"kubernetes.io/projected/c5081652-1310-458a-9462-521d0ccb4ec4-kube-api-access-rbp2j\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-hostroot\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-k8s-cni-cncf-io\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-bin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-bin\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-os-release\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-cnibin\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-etc-kubernetes\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-kubelet\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-iptables-alerter-script\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-cni-netd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984501 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-cni-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-run-systemd\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-var-lib-openvswitch\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-multus-daemon-config\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-config\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-socket-dir-parent\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-host-slash\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-run-multus-certs\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.984621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.983458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-multus-conf-dir\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-node-log\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-systemd-units\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985220 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-kubelet\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5081652-1310-458a-9462-521d0ccb4ec4-host-var-lib-cni-multus\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.985981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-run-netns\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.986410 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.985463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-log-socket\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.986410 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.986402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-env-overrides\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.986754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.986686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5081652-1310-458a-9462-521d0ccb4ec4-cni-binary-copy\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.986754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.986693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe0f964-c61c-4922-96f8-9b0977da64c8-host-slash\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.989852 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.987238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovnkube-script-lib\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.989852 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.987974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe0f964-c61c-4922-96f8-9b0977da64c8-ovn-node-metrics-cert\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.990031 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.989932 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:00:55.990031 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.989960 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:00:55.990031 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.989976 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:55.990198 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:55.990046 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:00:56.490024728 +0000 UTC m=+3.120227950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:55.992990 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.992964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbp2j\" (UniqueName: \"kubernetes.io/projected/c5081652-1310-458a-9462-521d0ccb4ec4-kube-api-access-rbp2j\") pod \"multus-7s62s\" (UID: \"c5081652-1310-458a-9462-521d0ccb4ec4\") " pod="openshift-multus/multus-7s62s" Jun 09 15:00:55.994102 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.994079 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhdr\" (UniqueName: \"kubernetes.io/projected/ffe0f964-c61c-4922-96f8-9b0977da64c8-kube-api-access-lzhdr\") pod \"ovnkube-node-59d86\" (UID: \"ffe0f964-c61c-4922-96f8-9b0977da64c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:55.994817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:55.994797 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26nn\" (UniqueName: \"kubernetes.io/projected/650f88f5-f3ab-4f14-9af8-2ab8edcfbc79-kube-api-access-h26nn\") pod \"iptables-alerter-c2hl2\" (UID: \"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79\") " pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:56.071704 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.071660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:00:56.079188 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.079149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4lzw" Jun 09 15:00:56.087128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.087101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" Jun 09 15:00:56.093087 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.093055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cx58x" Jun 09 15:00:56.099673 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.099650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" Jun 09 15:00:56.105460 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.105215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrdfn" Jun 09 15:00:56.111987 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.111964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s62s" Jun 09 15:00:56.119549 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.119484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2hl2" Jun 09 15:00:56.123284 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.123261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:00:56.387693 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.387609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:56.387693 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.387649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:56.387899 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.387766 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:56.387899 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.387774 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:56.387899 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.387832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:57.387817474 +0000 UTC m=+4.018020692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:56.387899 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.387847 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:57.387840928 +0000 UTC m=+4.018044145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:56.589589 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.589543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:56.589768 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.589668 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:00:56.589768 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.589682 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:00:56.589768 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.589691 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:56.589768 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:56.589738 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:00:57.589725579 +0000 UTC m=+4.219928798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:56.822366 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.822263 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:55:55 +0000 UTC" deadline="2028-02-18 19:29:43.350767342 +0000 UTC" Jun 09 15:00:56.822366 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:56.822313 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14860h28m46.528458999s" Jun 09 15:00:56.939912 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.939879 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5361ddb_922a_43cc_90bf_8543dc502c35.slice/crio-254d75dde1728b1445b449fa15ff54d03fa669be997a0ed11617f54d179a0298 WatchSource:0}: Error finding container 254d75dde1728b1445b449fa15ff54d03fa669be997a0ed11617f54d179a0298: Status 404 returned error can't find the container with id 254d75dde1728b1445b449fa15ff54d03fa669be997a0ed11617f54d179a0298 Jun 09 15:00:56.940687 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.940644 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5928f80d_3ea5_473c_a23c_a1f463713d20.slice/crio-a7b52897a0f76646978080948cc8f72a1222545d3b2be3cc5eb1c6d2335bd458 WatchSource:0}: Error finding container a7b52897a0f76646978080948cc8f72a1222545d3b2be3cc5eb1c6d2335bd458: Status 404 returned error can't find the container with id a7b52897a0f76646978080948cc8f72a1222545d3b2be3cc5eb1c6d2335bd458 Jun 09 15:00:56.945215 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.945183 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee049a3_ac31_42dd_aec3_ae7044f01c66.slice/crio-81571ae8ab33661fb7699b93bcbcd9f221dadb0321a5f36f8534b38a952b1978 WatchSource:0}: Error finding container 81571ae8ab33661fb7699b93bcbcd9f221dadb0321a5f36f8534b38a952b1978: Status 404 returned error can't find the container with id 81571ae8ab33661fb7699b93bcbcd9f221dadb0321a5f36f8534b38a952b1978 Jun 09 15:00:56.946376 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.946101 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650f88f5_f3ab_4f14_9af8_2ab8edcfbc79.slice/crio-69d74710aff01d17bab773a8076e4aef3a2b192c149e470df709b32235394b5a WatchSource:0}: Error finding container 69d74710aff01d17bab773a8076e4aef3a2b192c149e470df709b32235394b5a: Status 404 returned error can't find the container with id 69d74710aff01d17bab773a8076e4aef3a2b192c149e470df709b32235394b5a Jun 09 15:00:56.948856 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.948816 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5081652_1310_458a_9462_521d0ccb4ec4.slice/crio-3a3d4df558bdca3075ceceaff7f9b8cf36f265f6c4c3e0f3d7f8615bdd03fd19 WatchSource:0}: Error finding container 3a3d4df558bdca3075ceceaff7f9b8cf36f265f6c4c3e0f3d7f8615bdd03fd19: Status 404 returned error can't find the container with id 3a3d4df558bdca3075ceceaff7f9b8cf36f265f6c4c3e0f3d7f8615bdd03fd19 Jun 09 15:00:56.949867 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.949567 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode590afa8_41e6_43a9_9a78_9af443714ed8.slice/crio-f47ccc1f7af7502addff4fa57918af1cec732116976418444f0e8e001b5ad35e WatchSource:0}: Error finding container f47ccc1f7af7502addff4fa57918af1cec732116976418444f0e8e001b5ad35e: Status 404 returned error can't find the container with id f47ccc1f7af7502addff4fa57918af1cec732116976418444f0e8e001b5ad35e Jun 09 15:00:56.951578 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:00:56.951546 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d8f273_7739_4604_ab6e_40586464a82c.slice/crio-95b4a72166fad275e07f7c34462117b49874cde7491bf28fec82ab177c7c85c1 WatchSource:0}: Error finding container 95b4a72166fad275e07f7c34462117b49874cde7491bf28fec82ab177c7c85c1: Status 404 returned error can't find the container with id 95b4a72166fad275e07f7c34462117b49874cde7491bf28fec82ab177c7c85c1 Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.396490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.396535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.396710 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.396774 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:59.396754513 +0000 UTC m=+6.026957736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.396833 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:57.397207 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.396856 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:00:59.396848122 +0000 UTC m=+6.027051339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:57.598185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.598083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:57.598364 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.598329 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:00:57.598364 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.598352 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:00:57.598481 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.598367 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:57.598481 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.598425 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:00:59.598407339 +0000 UTC m=+6.228610564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:57.823034 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.822951 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:55:55 +0000 UTC" deadline="2027-12-26 13:03:08.270706747 +0000 UTC" Jun 09 15:00:57.823034 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.822989 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h2m10.447723002s" Jun 09 15:00:57.837950 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.837271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:57.837950 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.837397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:00:57.837950 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.837805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:57.837950 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.837903 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:00:57.838572 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.838349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:57.838572 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:57.838440 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:00:57.858097 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.858001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"abf49e7fdb23c9a42d3a8be1f1d9d22bf106cf67479558f594b83857bcd8c9fc"} Jun 09 15:00:57.869290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.868538 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" event={"ID":"e2f90cf2738dff4fcdeb8e9438957c52","Type":"ContainerStarted","Data":"5f6417e0ee5ebfc6a47fa9595f511340be82253570760f850aaea2ad7946be91"} Jun 09 15:00:57.873153 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.873116 2563 generic.go:356] "Generic (PLEG): container finished" podID="9f57b34bdcc2b7cf25aa820f4d27a7f6" containerID="e5119dd2f5acde8eba36ce3a5fedbfbf060439fdba2e46a04fe4069592a75fde" exitCode=0 Jun 09 15:00:57.873471 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.873381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" event={"ID":"9f57b34bdcc2b7cf25aa820f4d27a7f6","Type":"ContainerDied","Data":"e5119dd2f5acde8eba36ce3a5fedbfbf060439fdba2e46a04fe4069592a75fde"} Jun 09 15:00:57.885009 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.884965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s62s" event={"ID":"c5081652-1310-458a-9462-521d0ccb4ec4","Type":"ContainerStarted","Data":"3a3d4df558bdca3075ceceaff7f9b8cf36f265f6c4c3e0f3d7f8615bdd03fd19"} Jun 09 15:00:57.887313 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.887212 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-102.ec2.internal" podStartSLOduration=3.8871918819999998 podStartE2EDuration="3.887191882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:00:57.884138211 +0000 UTC m=+4.514341452" watchObservedRunningTime="2026-06-09 15:00:57.887191882 +0000 UTC m=+4.517395125" Jun 09 15:00:57.891054 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.891017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrdfn" event={"ID":"8ee049a3-ac31-42dd-aec3-ae7044f01c66","Type":"ContainerStarted","Data":"81571ae8ab33661fb7699b93bcbcd9f221dadb0321a5f36f8534b38a952b1978"} Jun 09 15:00:57.895591 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.895557 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zq96d" event={"ID":"c1d8f273-7739-4604-ab6e-40586464a82c","Type":"ContainerStarted","Data":"95b4a72166fad275e07f7c34462117b49874cde7491bf28fec82ab177c7c85c1"} Jun 09 15:00:57.901231 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.901199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" event={"ID":"e590afa8-41e6-43a9-9a78-9af443714ed8","Type":"ContainerStarted","Data":"f47ccc1f7af7502addff4fa57918af1cec732116976418444f0e8e001b5ad35e"} Jun 09 15:00:57.913423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.913345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4lzw" event={"ID":"dd337ebb-9c52-4890-adb4-0645c3b2b784","Type":"ContainerStarted","Data":"921257c92d22bf825eff05d06bb948d327c7a16b7d172ca599913148542ece91"} Jun 09 15:00:57.930389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.930350 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2hl2" event={"ID":"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79","Type":"ContainerStarted","Data":"69d74710aff01d17bab773a8076e4aef3a2b192c149e470df709b32235394b5a"} Jun 09 15:00:57.944764 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.944721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" event={"ID":"5928f80d-3ea5-473c-a23c-a1f463713d20","Type":"ContainerStarted","Data":"a7b52897a0f76646978080948cc8f72a1222545d3b2be3cc5eb1c6d2335bd458"} Jun 09 15:00:57.954104 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:57.954067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerStarted","Data":"254d75dde1728b1445b449fa15ff54d03fa669be997a0ed11617f54d179a0298"} Jun 09 15:00:58.985749 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:58.985673 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" event={"ID":"9f57b34bdcc2b7cf25aa820f4d27a7f6","Type":"ContainerStarted","Data":"13e0081f847a56657db5e0da5a9488930f1f1fdb4f5c9e6bcf487c9a6ad9c2f5"} Jun 09 15:00:59.413623 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.413528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:59.413623 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.413591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:59.413865 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.413720 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:59.413865 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.413782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:03.413762851 +0000 UTC m=+10.043966069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:00:59.414278 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.414255 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:59.414375 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.414316 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:03.414300348 +0000 UTC m=+10.044503572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:00:59.615629 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.615589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:59.615845 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.615825 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:00:59.615923 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.615851 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:00:59.615923 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.615865 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:59.616016 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.615924 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:01:03.615905583 +0000 UTC m=+10.246108821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:00:59.838379 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.838300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:00:59.838536 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.838434 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:00:59.838834 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.838813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:00:59.838978 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.838912 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:00:59.840879 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:00:59.840600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:00:59.840879 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:00:59.840713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:01.837460 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:01.837404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:01.837922 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:01.837404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:01.837922 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:01.837532 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:01.837922 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:01.837559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:01.837922 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:01.837678 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:01.837922 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:01.837775 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.449684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.449784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.449853 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.449891 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.449930 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:11.449908131 +0000 UTC m=+18.080111371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:03.450278 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.449950 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:11.449940336 +0000 UTC m=+18.080143560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:03.651621 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.651431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:03.651809 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.651690 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:03.651809 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.651713 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:03.651809 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.651727 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:03.651809 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.651786 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:01:11.651766827 +0000 UTC m=+18.281970047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:03.838260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.838131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:03.838610 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.838461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:03.838610 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:03.838482 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:03.838904 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.838879 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:03.839546 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.839376 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:03.839546 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:03.839493 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:05.837042 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:05.836993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:05.837450 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:05.837061 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:05.837450 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:05.837074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:05.837450 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:05.837203 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:05.837450 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:05.837362 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:05.837619 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:05.837468 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:07.836817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:07.836718 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:07.836817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:07.836739 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:07.836817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:07.836748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:07.837640 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:07.836863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:07.837640 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:07.837296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:07.837640 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:07.837386 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:09.836725 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:09.836683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:09.837201 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:09.836683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:09.837201 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:09.836835 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:09.837201 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:09.836846 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:09.837201 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:09.836941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:09.837201 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:09.837031 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:11.513836 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.513792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:11.513836 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.513836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:11.514495 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.513960 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:11.514495 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.514029 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:27.514010055 +0000 UTC m=+34.144213288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:11.514495 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.513960 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:11.514495 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.514101 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:27.514087647 +0000 UTC m=+34.144290868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:11.715050 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.715027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:11.715200 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.715183 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:11.715246 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.715205 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:11.715246 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.715215 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:11.715307 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.715264 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:01:27.715248569 +0000 UTC m=+34.345451794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:11.837286 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.837200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:11.837418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.837201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:11.837418 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.837321 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:11.837418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:11.837201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:11.837418 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.837379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:11.837546 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:11.837454 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:13.837450 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:13.837408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:13.837917 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:13.837514 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:13.837917 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:13.837564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:13.837917 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:13.837621 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:13.837917 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:13.837678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:13.837917 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:13.837803 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:15.836656 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:15.836621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:15.837266 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:15.836621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:15.837266 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:15.836756 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:15.837266 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:15.836846 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:15.837266 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:15.836619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:15.837266 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:15.836942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:17.025395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.024863 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zq96d" event={"ID":"c1d8f273-7739-4604-ab6e-40586464a82c","Type":"ContainerStarted","Data":"814f95fca78151505c2423a95e851203bcfb7bd802f31d6b4e890946e097f908"} Jun 09 15:01:17.027110 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.027083 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" event={"ID":"e590afa8-41e6-43a9-9a78-9af443714ed8","Type":"ContainerStarted","Data":"0f0712770562bf486da267b456245924eb543d5c85dd38e507e27db0008a8824"} Jun 09 15:01:17.028629 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.028583 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4lzw" event={"ID":"dd337ebb-9c52-4890-adb4-0645c3b2b784","Type":"ContainerStarted","Data":"abaf8e9054d0ed71cdfe2c12c8633b4f1c52bc783a6cfc2857435bd8c7fe013a"} Jun 09 15:01:17.030080 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.030057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" event={"ID":"5928f80d-3ea5-473c-a23c-a1f463713d20","Type":"ContainerStarted","Data":"38d7a1da2dab4318716256613cefed0618a5c65672b3d6a02fd8d81773be2e37"} Jun 09 15:01:17.031751 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.031725 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="8bf4dea90320429a84133b7a87814f98f154e9e473376389177dab6bac84bf5f" exitCode=0 Jun 09 15:01:17.031856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.031813 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"8bf4dea90320429a84133b7a87814f98f154e9e473376389177dab6bac84bf5f"} Jun 09 15:01:17.035227 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"89eb54150d4c122c3e9cfe1dff034cdf67c274d12b832fa026175402dad853e0"} Jun 09 15:01:17.035341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"360278ce6c1339fe6ac5c46bbafb54129c307bc773d6fcbbb642176956e591d8"} Jun 09 15:01:17.035408 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"25b7e239c4cc5f3ca948319b53c9bdc885eadc2d0dcaafaacf2eef62b04a9b37"} Jun 09 15:01:17.035463 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"6d36755d24f03b3263007f63f00067db64ee510af01c7de071a2e3d25961d31e"} Jun 09 15:01:17.035516 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"a7820366e27123eb2908f185677e8b6d88eaa12a8f50aa69edbd814369e8e77d"} Jun 09 15:01:17.035516 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.035510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"f064e668e4e3fc825670cfc59e8e8a43d5b2ddd03ec3cb8bee9ce8372bd1ffac"} Jun 09 15:01:17.036747 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.036727 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s62s" event={"ID":"c5081652-1310-458a-9462-521d0ccb4ec4","Type":"ContainerStarted","Data":"97a644dca9b9cc443c6fd1e0d2f1105595b43a30258377ad30ff74d3f728c80a"} Jun 09 15:01:17.038204 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.038156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrdfn" event={"ID":"8ee049a3-ac31-42dd-aec3-ae7044f01c66","Type":"ContainerStarted","Data":"c6f23d1d98a6fd804d3709cda6c256b5e32d33a9533cb9b5e4f45ff4076888f9"} Jun 09 15:01:17.049961 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.049901 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-102.ec2.internal" podStartSLOduration=23.049879654 podStartE2EDuration="23.049879654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:00:59.004003002 +0000 UTC m=+5.634206243" watchObservedRunningTime="2026-06-09 15:01:17.049879654 +0000 UTC m=+23.680082895" Jun 09 15:01:17.050569 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.050503 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zq96d" podStartSLOduration=4.9135879639999995 podStartE2EDuration="24.050493834s" totalImagesPullingTime="19.13690587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:17.049732836 +0000 UTC m=+23.679936079" watchObservedRunningTime="2026-06-09 15:01:17.050493834 +0000 UTC m=+23.680697073" Jun 09 15:01:17.098108 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.098050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xrdfn" podStartSLOduration=3.952702024 podStartE2EDuration="23.098030895s" totalImagesPullingTime="19.145328871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:17.075091221 +0000 UTC m=+23.705294464" watchObservedRunningTime="2026-06-09 15:01:17.098030895 +0000 UTC m=+23.728234136" Jun 09 15:01:17.098312 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.098146 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7s62s" podStartSLOduration=3.903236898 podStartE2EDuration="23.098140976s" totalImagesPullingTime="19.194904078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:17.097901524 +0000 UTC m=+23.728104767" watchObservedRunningTime="2026-06-09 15:01:17.098140976 +0000 UTC m=+23.728344218" Jun 09 15:01:17.116702 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.116638 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rwnqh" podStartSLOduration=3.946914354 podStartE2EDuration="23.116618142s" totalImagesPullingTime="19.169703788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:17.116247237 +0000 UTC m=+23.746450478" watchObservedRunningTime="2026-06-09 15:01:17.116618142 +0000 UTC m=+23.746821381" Jun 09 15:01:17.591412 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.591383 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:01:17.837581 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.837517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:17.837792 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.837517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:17.837792 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.837619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:17.837792 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:17.837619 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:17.837792 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:17.837718 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:17.838001 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:17.837798 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:17.843449 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.843362 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:01:17.59140424Z","UUID":"8bb44a50-ab79-412d-aa95-d00e253eba15","Handler":null,"Name":"","Endpoint":""} Jun 09 15:01:17.844868 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.844848 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:01:17.844995 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:17.844883 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:01:18.042657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:18.042620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" event={"ID":"e590afa8-41e6-43a9-9a78-9af443714ed8","Type":"ContainerStarted","Data":"43e9599b4f1a356de4e48541319e8371fd425e7ffbd9318c109f5a3b89de5488"} Jun 09 15:01:18.044110 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:18.044082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2hl2" event={"ID":"650f88f5-f3ab-4f14-9af8-2ab8edcfbc79","Type":"ContainerStarted","Data":"66493cb50c57c1ee231936f990842c3d1cbde8ec53151b15fea9a29389af71e7"} Jun 09 15:01:18.061076 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:18.061029 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n4lzw" podStartSLOduration=9.075133496 podStartE2EDuration="24.061011716s" totalImagesPullingTime="14.98587822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:17.167600977 +0000 UTC m=+23.797804216" watchObservedRunningTime="2026-06-09 15:01:18.061011716 +0000 UTC m=+24.691214962" Jun 09 15:01:18.061419 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:18.061398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c2hl2" podStartSLOduration=4.899378095 podStartE2EDuration="24.061392565s" totalImagesPullingTime="19.16201447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:18.060879971 +0000 UTC m=+24.691083212" watchObservedRunningTime="2026-06-09 15:01:18.061392565 +0000 UTC m=+24.691595817" Jun 09 15:01:19.049588 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.049547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" event={"ID":"e590afa8-41e6-43a9-9a78-9af443714ed8","Type":"ContainerStarted","Data":"3971d78e83aaf567d20c6bee8399d71ea78be35e96eb3b325f9a90d4a4c67ef8"} Jun 09 15:01:19.054222 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.054190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"9eb08135ad1f3c3399d430627236b1edd419700a56f72182b8820e5cc866a2ce"} Jun 09 15:01:19.073550 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.073466 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9vf9x" podStartSLOduration=3.755699892 podStartE2EDuration="25.073444514s" totalImagesPullingTime="21.317744622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:19.072512205 +0000 UTC m=+25.702715459" watchObservedRunningTime="2026-06-09 15:01:19.073444514 +0000 UTC m=+25.703647753" Jun 09 15:01:19.837208 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.836937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:19.837395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.836952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:19.837395 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:19.837311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:19.837395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:19.837011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:19.837559 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:19.837402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:19.837559 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:19.837509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:21.348270 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:21.348228 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:01:21.348917 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:21.348897 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:01:21.837468 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:21.837382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:21.837468 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:21.837413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:21.837684 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:21.837384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:21.837684 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:21.837507 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:21.837684 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:21.837592 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:21.837684 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:21.837648 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:22.061969 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:22.061937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:01:22.062423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:22.062402 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zq96d" Jun 09 15:01:23.065709 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.065441 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="4f620e808163c0e0729c0a97a14f2b366025fdc1243d01e309d514414a3b66d2" exitCode=0 Jun 09 15:01:23.066412 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.065522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"4f620e808163c0e0729c0a97a14f2b366025fdc1243d01e309d514414a3b66d2"} Jun 09 15:01:23.069469 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.069436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" event={"ID":"ffe0f964-c61c-4922-96f8-9b0977da64c8","Type":"ContainerStarted","Data":"60e97aa758ce2e3778d2619c7cbb5121351053b12591d52a259208bc68f35443"} Jun 09 15:01:23.110054 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.109991 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" podStartSLOduration=9.872442016 podStartE2EDuration="29.109974444s" totalImagesPullingTime="19.237532428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:23.109559182 +0000 UTC m=+29.739762421" watchObservedRunningTime="2026-06-09 15:01:23.109974444 +0000 UTC m=+29.740177684" Jun 09 15:01:23.839907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.839873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:23.840079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.839913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:23.840079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:23.839916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:23.840079 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:23.839978 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:23.840079 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:23.840055 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:23.840230 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:23.840139 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:24.071513 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.071490 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:24.071952 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.071569 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:24.071952 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.071926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:24.088577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.088535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:24.089261 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.089229 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:24.228814 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.228782 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcw9w"] Jun 09 15:01:24.228968 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.228953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:24.229088 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:24.229069 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:24.232435 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.232407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vnw84"] Jun 09 15:01:24.232579 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.232564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:24.232726 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:24.232703 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:24.233128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.233105 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt8k5"] Jun 09 15:01:24.233278 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:24.233225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:24.233361 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:24.233309 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:25.076110 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:25.076077 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="a8d156db1d7bdec9283de75356bdc5f5b799136346faa457d937e67091fd4e0e" exitCode=0 Jun 09 15:01:25.076617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:25.076180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"a8d156db1d7bdec9283de75356bdc5f5b799136346faa457d937e67091fd4e0e"} Jun 09 15:01:25.837142 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:25.836910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:25.837306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:25.836920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:25.837306 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:25.837205 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:25.837306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:25.836920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:25.837306 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:25.837260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:25.837457 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:25.837329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:27.083223 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.083190 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="2fb0eb017ef7762658ed3a014975fa90258fa8b68d1e350f1c6d79cc24a4fcad" exitCode=0 Jun 09 15:01:27.083782 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.083245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"2fb0eb017ef7762658ed3a014975fa90258fa8b68d1e350f1c6d79cc24a4fcad"} Jun 09 15:01:27.538396 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.538362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:27.538574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.538406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:27.538574 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.538527 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:27.538672 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.538589 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.538570458 +0000 UTC m=+66.168773676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:27.538672 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.538527 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:27.538767 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.538680 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret podName:cf3cd76b-1e7e-4707-8764-fc7e2c806921 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.538662176 +0000 UTC m=+66.168865404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret") pod "global-pull-secret-syncer-wcw9w" (UID: "cf3cd76b-1e7e-4707-8764-fc7e2c806921") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:27.740703 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.740604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:27.740878 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.740790 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:27.740878 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.740815 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:27.740878 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.740827 2563 projected.go:196] Error preparing data for projected volume kube-api-access-724bm for pod openshift-network-diagnostics/network-check-target-mt8k5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:27.741033 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.740889 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm podName:38158225-a266-464a-88c1-654aff72fb5c nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.740870689 +0000 UTC m=+66.371073908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-724bm" (UniqueName: "kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm") pod "network-check-target-mt8k5" (UID: "38158225-a266-464a-88c1-654aff72fb5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:27.840750 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.840722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:27.840908 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.840721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:27.840908 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.840838 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt8k5" podUID="38158225-a266-464a-88c1-654aff72fb5c" Jun 09 15:01:27.841027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:27.840722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:27.841027 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.840936 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:01:27.841120 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:27.841035 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcw9w" podUID="cf3cd76b-1e7e-4707-8764-fc7e2c806921" Jun 09 15:01:29.175552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.175523 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-102.ec2.internal" event="NodeReady" Jun 09 15:01:29.176144 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.175680 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:01:29.208812 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.208771 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:01:29.213137 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.213115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.216976 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.216395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2x6bf\"" Jun 09 15:01:29.216976 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.216433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:01:29.216976 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.216568 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:01:29.216976 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.216639 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:01:29.220366 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.220315 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xmlqd"] Jun 09 15:01:29.223890 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.223863 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:01:29.225405 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.225385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.227988 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.227961 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:01:29.228276 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.228254 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:01:29.228365 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.228287 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:01:29.228521 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.228492 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zkrcb\"" Jun 09 15:01:29.228721 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.228701 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9cf2d"] Jun 09 15:01:29.233041 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.232996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.233233 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.233049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmlqd"] Jun 09 15:01:29.236443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.236040 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:01:29.236443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.236145 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4tsw\"" Jun 09 15:01:29.236443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.236186 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:01:29.236443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.236155 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:01:29.239150 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.239128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cf2d"] Jun 09 15:01:29.353301 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353301 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf692b1c-dee2-46b4-9d86-706ec5bc51db-tmp-dir\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48761377-1856-4b2d-875c-c9e706bd9f8f-cert\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpsv\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98r5c\" (UniqueName: \"kubernetes.io/projected/cf692b1c-dee2-46b4-9d86-706ec5bc51db-kube-api-access-98r5c\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.353561 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.354068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.354068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhpfb\" (UniqueName: \"kubernetes.io/projected/48761377-1856-4b2d-875c-c9e706bd9f8f-kube-api-access-rhpfb\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.354068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf692b1c-dee2-46b4-9d86-706ec5bc51db-config-volume\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.354068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.353656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454626 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454626 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhpfb\" (UniqueName: \"kubernetes.io/projected/48761377-1856-4b2d-875c-c9e706bd9f8f-kube-api-access-rhpfb\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf692b1c-dee2-46b4-9d86-706ec5bc51db-config-volume\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.454856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf692b1c-dee2-46b4-9d86-706ec5bc51db-tmp-dir\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.454913 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.454972 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:01:29.954955789 +0000 UTC m=+36.585159007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.454918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48761377-1856-4b2d-875c-c9e706bd9f8f-cert\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpsv\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.455225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98r5c\" (UniqueName: \"kubernetes.io/projected/cf692b1c-dee2-46b4-9d86-706ec5bc51db-kube-api-access-98r5c\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.455610 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.455329 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:29.455610 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.455349 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:29.455610 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.455412 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:29.955397563 +0000 UTC m=+36.585600781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:29.455773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.455773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf692b1c-dee2-46b4-9d86-706ec5bc51db-tmp-dir\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.455773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.455756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.456185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.456143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf692b1c-dee2-46b4-9d86-706ec5bc51db-config-volume\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.459564 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.459534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.459564 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.459562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.459773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.459622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48761377-1856-4b2d-875c-c9e706bd9f8f-cert\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.464107 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.464057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98r5c\" (UniqueName: \"kubernetes.io/projected/cf692b1c-dee2-46b4-9d86-706ec5bc51db-kube-api-access-98r5c\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.464269 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.464140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpsv\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.464269 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.464186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.464442 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.464418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhpfb\" (UniqueName: \"kubernetes.io/projected/48761377-1856-4b2d-875c-c9e706bd9f8f-kube-api-access-rhpfb\") pod \"ingress-canary-9cf2d\" (UID: \"48761377-1856-4b2d-875c-c9e706bd9f8f\") " pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.546023 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.545981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cf2d" Jun 09 15:01:29.717051 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.716754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cf2d"] Jun 09 15:01:29.841243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.841211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:29.841243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.841244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:29.841456 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.841326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:29.844669 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844200 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:01:29.844669 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844423 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x45km\"" Jun 09 15:01:29.844669 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844479 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whcd4\"" Jun 09 15:01:29.844669 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844432 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:01:29.844669 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844662 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:01:29.845011 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.844734 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:01:29.958983 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.958941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:29.959202 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:29.959032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:29.959202 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.959135 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:29.959320 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.959221 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:01:30.959199578 +0000 UTC m=+37.589402804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:29.959320 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.959140 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:29.959320 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.959275 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:29.959454 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:29.959342 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:30.959319634 +0000 UTC m=+37.589523069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:30.968781 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:30.968736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:30.968834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:30.968873 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:30.968943 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:30.968944 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:01:32.968930012 +0000 UTC m=+39.599133235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:30.968958 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:30.969452 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:30.969007 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:32.968990991 +0000 UTC m=+39.599194208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:31.167419 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:01:31.167375 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48761377_1856_4b2d_875c_c9e706bd9f8f.slice/crio-b6cdc60db9537c1a495d8d1a233a89e98974dbda5638694821f6bd809b79444c WatchSource:0}: Error finding container b6cdc60db9537c1a495d8d1a233a89e98974dbda5638694821f6bd809b79444c: Status 404 returned error can't find the container with id b6cdc60db9537c1a495d8d1a233a89e98974dbda5638694821f6bd809b79444c Jun 09 15:01:32.099228 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:32.099191 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="7adb4bcca6757660a98a2fd1e95413af72576b3111cd85a7b5ff8874623b1be3" exitCode=0 Jun 09 15:01:32.099751 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:32.099273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"7adb4bcca6757660a98a2fd1e95413af72576b3111cd85a7b5ff8874623b1be3"} Jun 09 15:01:32.100339 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:32.100320 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cf2d" event={"ID":"48761377-1856-4b2d-875c-c9e706bd9f8f","Type":"ContainerStarted","Data":"b6cdc60db9537c1a495d8d1a233a89e98974dbda5638694821f6bd809b79444c"} Jun 09 15:01:32.983427 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:32.983388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:32.983601 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:32.983453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:32.983601 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:32.983573 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:32.983601 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:32.983575 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:32.983756 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:32.983653 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:01:36.983630104 +0000 UTC m=+43.613833325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:32.983756 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:32.983584 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:32.983756 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:32.983718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:36.983706382 +0000 UTC m=+43.613909599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:33.106729 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:33.106695 2563 generic.go:356] "Generic (PLEG): container finished" podID="d5361ddb-922a-43cc-90bf-8543dc502c35" containerID="1ddfe3000c06f39ecc1c03711f4b9e9245d6c9b20d7ab0eb84d6da082f6202a7" exitCode=0 Jun 09 15:01:33.107093 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:33.106758 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerDied","Data":"1ddfe3000c06f39ecc1c03711f4b9e9245d6c9b20d7ab0eb84d6da082f6202a7"} Jun 09 15:01:33.222791 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:33.222749 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:33.303566 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:33.303522 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:34.112248 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:34.112217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cx58x" event={"ID":"d5361ddb-922a-43cc-90bf-8543dc502c35","Type":"ContainerStarted","Data":"aff289f0982364b274c1d5a06f91879da21798a6f2f075c49eee896b294e518e"} Jun 09 15:01:34.134725 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:34.134665 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cx58x" podStartSLOduration=9.519933315 podStartE2EDuration="40.134647417s" totalImagesPullingTime="30.614714102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:34.133472151 +0000 UTC m=+40.763675391" watchObservedRunningTime="2026-06-09 15:01:34.134647417 +0000 UTC m=+40.764850657" Jun 09 15:01:34.255552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:34.255510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:34.312388 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:34.312355 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:36.119683 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:36.119588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cf2d" event={"ID":"48761377-1856-4b2d-875c-c9e706bd9f8f","Type":"ContainerStarted","Data":"c0b79cbf1648f4178ab7e9eb9039e117fb43404897d50fa80719c3bb05d83265"} Jun 09 15:01:36.134665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:36.134603 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9cf2d" podStartSLOduration=2.445602672 podStartE2EDuration="7.134582514s" totalImagesPullingTime="4.688979842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:36.133676583 +0000 UTC m=+42.763879823" watchObservedRunningTime="2026-06-09 15:01:36.134582514 +0000 UTC m=+42.764785754" Jun 09 15:01:37.011962 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:37.011921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:37.011980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:37.012076 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:37.012087 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:37.012095 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:37.012137 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:45.012123377 +0000 UTC m=+51.642326595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:37.012152 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:37.012150 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:01:45.01214401 +0000 UTC m=+51.642347228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:37.328997 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:37.328912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:37.392025 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:37.391990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:45.068861 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:45.068814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:45.068892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:45.068990 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:45.069048 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:45.069063 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:02:01.069047532 +0000 UTC m=+67.699250751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:45.069064 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:01:45.069419 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:45.069093 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:01.06908722 +0000 UTC m=+67.699290438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:01:56.095407 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.095377 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59d86" Jun 09 15:01:56.487648 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.487566 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg"] Jun 09 15:01:56.532231 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.532188 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg"] Jun 09 15:01:56.532395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.532285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.535302 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.535275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 15:01:56.535464 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.535298 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 15:01:56.535464 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.535297 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 15:01:56.535464 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.535458 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 15:01:56.535642 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.535298 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-flzlg\"" Jun 09 15:01:56.548287 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.548258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c701304-864c-4349-8824-82ca3f05c5aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.548472 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.548307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jcq\" (UniqueName: \"kubernetes.io/projected/3c701304-864c-4349-8824-82ca3f05c5aa-kube-api-access-b2jcq\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.649080 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.649036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c701304-864c-4349-8824-82ca3f05c5aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.649279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.649102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jcq\" (UniqueName: \"kubernetes.io/projected/3c701304-864c-4349-8824-82ca3f05c5aa-kube-api-access-b2jcq\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.652727 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.652707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c701304-864c-4349-8824-82ca3f05c5aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.658611 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.658580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jcq\" (UniqueName: \"kubernetes.io/projected/3c701304-864c-4349-8824-82ca3f05c5aa-kube-api-access-b2jcq\") pod \"managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg\" (UID: \"3c701304-864c-4349-8824-82ca3f05c5aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.851236 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.851208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:01:56.999230 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:56.999194 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg"] Jun 09 15:01:57.020583 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:01:57.020555 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c701304_864c_4349_8824_82ca3f05c5aa.slice/crio-22d8ffd1df8b92b8c07aa8526d121128a56d11ee9bebca9d00a42a90fbf78b56 WatchSource:0}: Error finding container 22d8ffd1df8b92b8c07aa8526d121128a56d11ee9bebca9d00a42a90fbf78b56: Status 404 returned error can't find the container with id 22d8ffd1df8b92b8c07aa8526d121128a56d11ee9bebca9d00a42a90fbf78b56 Jun 09 15:01:57.170896 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:57.170810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerStarted","Data":"22d8ffd1df8b92b8c07aa8526d121128a56d11ee9bebca9d00a42a90fbf78b56"} Jun 09 15:01:59.571255 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.571208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:01:59.571743 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.571354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:59.574132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.574106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:01:59.574132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.574126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:01:59.581634 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:59.581602 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:01:59.581789 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:01:59.581715 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:03.581690046 +0000 UTC m=+130.211893277 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : secret "metrics-daemon-secret" not found Jun 09 15:01:59.584239 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.584203 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf3cd76b-1e7e-4707-8764-fc7e2c806921-original-pull-secret\") pod \"global-pull-secret-syncer-wcw9w\" (UID: \"cf3cd76b-1e7e-4707-8764-fc7e2c806921\") " pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:01:59.772955 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.772920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:59.775675 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.775654 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:01:59.786003 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.785972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:01:59.796713 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.796674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-724bm\" (UniqueName: \"kubernetes.io/projected/38158225-a266-464a-88c1-654aff72fb5c-kube-api-access-724bm\") pod \"network-check-target-mt8k5\" (UID: \"38158225-a266-464a-88c1-654aff72fb5c\") " pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:59.857345 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.857311 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whcd4\"" Jun 09 15:01:59.865626 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.865595 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:01:59.872799 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:01:59.872766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcw9w" Jun 09 15:02:00.002533 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.002503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt8k5"] Jun 09 15:02:00.005430 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:02:00.005401 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38158225_a266_464a_88c1_654aff72fb5c.slice/crio-ebb62928c38d2791f59962e81f298d60b60e9e57046520163c851870040dc95d WatchSource:0}: Error finding container ebb62928c38d2791f59962e81f298d60b60e9e57046520163c851870040dc95d: Status 404 returned error can't find the container with id ebb62928c38d2791f59962e81f298d60b60e9e57046520163c851870040dc95d Jun 09 15:02:00.030108 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.030077 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcw9w"] Jun 09 15:02:00.033099 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:02:00.033072 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3cd76b_1e7e_4707_8764_fc7e2c806921.slice/crio-3d27fa90745b3565b6056b7c569bd0c3485094de36d32fc6871cebfcb28468bf WatchSource:0}: Error finding container 3d27fa90745b3565b6056b7c569bd0c3485094de36d32fc6871cebfcb28468bf: Status 404 returned error can't find the container with id 3d27fa90745b3565b6056b7c569bd0c3485094de36d32fc6871cebfcb28468bf Jun 09 15:02:00.180699 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.180594 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerStarted","Data":"58359511ee35164cccc040c09b2c909cb8b1846f4f494681dd4ae6f07d92e081"} Jun 09 15:02:00.181741 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.181715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt8k5" event={"ID":"38158225-a266-464a-88c1-654aff72fb5c","Type":"ContainerStarted","Data":"ebb62928c38d2791f59962e81f298d60b60e9e57046520163c851870040dc95d"} Jun 09 15:02:00.182730 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.182708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcw9w" event={"ID":"cf3cd76b-1e7e-4707-8764-fc7e2c806921","Type":"ContainerStarted","Data":"3d27fa90745b3565b6056b7c569bd0c3485094de36d32fc6871cebfcb28468bf"} Jun 09 15:02:00.197674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:00.197626 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" podStartSLOduration=1.5388315000000001 podStartE2EDuration="4.197609456s" totalImagesPullingTime="2.658777956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:00.197020364 +0000 UTC m=+66.827223640" watchObservedRunningTime="2026-06-09 15:02:00.197609456 +0000 UTC m=+66.827812696" Jun 09 15:02:01.083251 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:01.083211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:01.083294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:01.083398 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:01.083418 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:01.083434 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:01.083480 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:02:33.083456644 +0000 UTC m=+99.713659890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:02:01.083665 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:01.083495 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:33.08348939 +0000 UTC m=+99.713692607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:02:04.195719 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:04.195683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt8k5" event={"ID":"38158225-a266-464a-88c1-654aff72fb5c","Type":"ContainerStarted","Data":"f4b83aad612396ee56bed4dc53e114135626fc5492c4625051f2b82fa780a13e"} Jun 09 15:02:04.196121 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:04.195825 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:02:04.213781 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:04.213718 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mt8k5" podStartSLOduration=66.754661896 podStartE2EDuration="1m10.213702463s" totalImagesPullingTime="3.459040567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:04.211945989 +0000 UTC m=+70.842149230" watchObservedRunningTime="2026-06-09 15:02:04.213702463 +0000 UTC m=+70.843905728" Jun 09 15:02:07.206909 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:07.206863 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcw9w" event={"ID":"cf3cd76b-1e7e-4707-8764-fc7e2c806921","Type":"ContainerStarted","Data":"a306b91fe54bef56dce6b39e4bfacda3f3e93ca2b27900ca6092791493fa16d1"} Jun 09 15:02:07.222040 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:07.221981 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wcw9w" podStartSLOduration=66.856295378 podStartE2EDuration="1m13.221962525s" totalImagesPullingTime="6.365667147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:07.221590811 +0000 UTC m=+73.851794051" watchObservedRunningTime="2026-06-09 15:02:07.221962525 +0000 UTC m=+73.852165764" Jun 09 15:02:33.115612 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:33.115480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:02:33.115612 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:33.115532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:02:33.116102 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:33.115629 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:33.116102 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:33.115634 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:02:33.116102 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:33.115655 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:02:33.116102 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:33.115688 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:03:37.115673049 +0000 UTC m=+163.745876279 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:02:33.116102 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:02:33.115702 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:37.115696109 +0000 UTC m=+163.745899326 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:02:35.201927 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:02:35.201897 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mt8k5" Jun 09 15:03:03.636756 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:03.636713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:03:03.637274 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:03.636845 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:03:03.637274 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:03.636915 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs podName:96d6550e-0be0-4b01-bac3-dac2924a6f04 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:05.636896027 +0000 UTC m=+252.267099248 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs") pod "network-metrics-daemon-vnw84" (UID: "96d6550e-0be0-4b01-bac3-dac2924a6f04") : secret "metrics-daemon-secret" not found Jun 09 15:03:32.228254 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:32.228212 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" Jun 09 15:03:32.239481 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:32.239452 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xmlqd" podUID="cf692b1c-dee2-46b4-9d86-706ec5bc51db" Jun 09 15:03:32.407736 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:32.407706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:03:32.407913 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:32.407706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:03:32.862366 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:32.862322 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vnw84" podUID="96d6550e-0be0-4b01-bac3-dac2924a6f04" Jun 09 15:03:37.170102 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:37.170058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:37.170117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:37.170227 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:37.170244 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d76d44fc-jcq98: secret "image-registry-tls" not found Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:37.170291 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls podName:be8ccc71-9900-434f-9762-83b6e04a3214 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:39.170277528 +0000 UTC m=+285.800480745 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls") pod "image-registry-5d76d44fc-jcq98" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214") : secret "image-registry-tls" not found Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:37.170226 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:37.170500 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:03:37.170374 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls podName:cf692b1c-dee2-46b4-9d86-706ec5bc51db nodeName:}" failed. No retries permitted until 2026-06-09 15:05:39.170359755 +0000 UTC m=+285.800562973 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls") pod "dns-default-xmlqd" (UID: "cf692b1c-dee2-46b4-9d86-706ec5bc51db") : secret "dns-default-metrics-tls" not found Jun 09 15:03:47.837342 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:03:47.837255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:04:00.473504 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:00.473467 2563 generic.go:356] "Generic (PLEG): container finished" podID="3c701304-864c-4349-8824-82ca3f05c5aa" containerID="58359511ee35164cccc040c09b2c909cb8b1846f4f494681dd4ae6f07d92e081" exitCode=255 Jun 09 15:04:00.473915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:00.473540 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerDied","Data":"58359511ee35164cccc040c09b2c909cb8b1846f4f494681dd4ae6f07d92e081"} Jun 09 15:04:00.479001 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:00.478978 2563 scope.go:117] "RemoveContainer" containerID="58359511ee35164cccc040c09b2c909cb8b1846f4f494681dd4ae6f07d92e081" Jun 09 15:04:01.478290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:01.478253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerStarted","Data":"74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275"} Jun 09 15:04:26.480025 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.479988 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf"] Jun 09 15:04:26.481866 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.481844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.484427 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.484401 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc"] Jun 09 15:04:26.486380 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.486143 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.487421 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.487131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" Jun 09 15:04:26.488139 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.487816 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.488139 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.488049 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 15:04:26.490331 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.488308 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-n2rqt\"" Jun 09 15:04:26.490331 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.488446 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 15:04:26.490331 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.489146 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78"] Jun 09 15:04:26.491077 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.491056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pz9dr\"" Jun 09 15:04:26.492202 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.492184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.497484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.497453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 15:04:26.497484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.497477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.497754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.497500 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbkjm\"" Jun 09 15:04:26.498934 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.498912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.499206 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.499189 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 15:04:26.500041 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.500022 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf"] Jun 09 15:04:26.502580 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.502562 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc"] Jun 09 15:04:26.509206 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.509182 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78"] Jun 09 15:04:26.582807 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.582774 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-ftck8"] Jun 09 15:04:26.584515 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.584497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.587026 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.587007 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 15:04:26.587153 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.587044 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-snp45\"" Jun 09 15:04:26.587292 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.587259 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 15:04:26.587292 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.587262 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.588055 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.588038 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.592175 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.592142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 15:04:26.595787 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.595763 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ftck8"] Jun 09 15:04:26.620513 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e58479b6-83db-4c20-91fd-f0d378e402b4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.620690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt98s\" (UniqueName: \"kubernetes.io/projected/08abd51a-152c-4463-9f43-5be3545ccefc-kube-api-access-jt98s\") pod \"network-check-source-dbd9cf844-v29gc\" (UID: \"08abd51a-152c-4463-9f43-5be3545ccefc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" Jun 09 15:04:26.620690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8r4c\" (UniqueName: \"kubernetes.io/projected/e58479b6-83db-4c20-91fd-f0d378e402b4-kube-api-access-z8r4c\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.620690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/427a5d5c-7dc1-4991-b731-2a70b934aa64-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.620690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/427a5d5c-7dc1-4991-b731-2a70b934aa64-kube-api-access-fpx95\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.620690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.620873 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.620752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/427a5d5c-7dc1-4991-b731-2a70b934aa64-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.721756 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-snapshots\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.721756 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-498q4\" (UniqueName: \"kubernetes.io/projected/44791603-2b8f-4b33-bc0b-c920bc34cb1f-kube-api-access-498q4\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e58479b6-83db-4c20-91fd-f0d378e402b4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44791603-2b8f-4b33-bc0b-c920bc34cb1f-serving-cert\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt98s\" (UniqueName: \"kubernetes.io/projected/08abd51a-152c-4463-9f43-5be3545ccefc-kube-api-access-jt98s\") pod \"network-check-source-dbd9cf844-v29gc\" (UID: \"08abd51a-152c-4463-9f43-5be3545ccefc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/427a5d5c-7dc1-4991-b731-2a70b934aa64-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/427a5d5c-7dc1-4991-b731-2a70b934aa64-kube-api-access-fpx95\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.721971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/427a5d5c-7dc1-4991-b731-2a70b934aa64-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.721981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-service-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.722125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-trusted-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:26.722144 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.722190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8r4c\" (UniqueName: \"kubernetes.io/projected/e58479b6-83db-4c20-91fd-f0d378e402b4-kube-api-access-z8r4c\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.722265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-tmp\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.722404 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:26.722371 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.222346477 +0000 UTC m=+213.852549719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:26.722705 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.722652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e58479b6-83db-4c20-91fd-f0d378e402b4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.722705 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.722667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/427a5d5c-7dc1-4991-b731-2a70b934aa64-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.724210 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.724192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/427a5d5c-7dc1-4991-b731-2a70b934aa64-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.731518 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.731451 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8r4c\" (UniqueName: \"kubernetes.io/projected/e58479b6-83db-4c20-91fd-f0d378e402b4-kube-api-access-z8r4c\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:26.731813 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.731780 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt98s\" (UniqueName: \"kubernetes.io/projected/08abd51a-152c-4463-9f43-5be3545ccefc-kube-api-access-jt98s\") pod \"network-check-source-dbd9cf844-v29gc\" (UID: \"08abd51a-152c-4463-9f43-5be3545ccefc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" Jun 09 15:04:26.732121 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.732102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/427a5d5c-7dc1-4991-b731-2a70b934aa64-kube-api-access-fpx95\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-q8jnf\" (UID: \"427a5d5c-7dc1-4991-b731-2a70b934aa64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.796369 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.796332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" Jun 09 15:04:26.801895 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.801868 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" Jun 09 15:04:26.823088 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-tmp\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.823302 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-snapshots\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.823302 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-498q4\" (UniqueName: \"kubernetes.io/projected/44791603-2b8f-4b33-bc0b-c920bc34cb1f-kube-api-access-498q4\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.823302 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44791603-2b8f-4b33-bc0b-c920bc34cb1f-serving-cert\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.823462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-service-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.823462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.823403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-trusted-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.824178 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.824133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-tmp\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.824322 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.824222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/44791603-2b8f-4b33-bc0b-c920bc34cb1f-snapshots\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.824462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.824441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-service-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.824590 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.824573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44791603-2b8f-4b33-bc0b-c920bc34cb1f-trusted-ca-bundle\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.826381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.826358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44791603-2b8f-4b33-bc0b-c920bc34cb1f-serving-cert\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.831488 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.831452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-498q4\" (UniqueName: \"kubernetes.io/projected/44791603-2b8f-4b33-bc0b-c920bc34cb1f-kube-api-access-498q4\") pod \"insights-operator-896549976-ftck8\" (UID: \"44791603-2b8f-4b33-bc0b-c920bc34cb1f\") " pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.893497 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.893463 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-ftck8" Jun 09 15:04:26.934527 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.934499 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf"] Jun 09 15:04:26.937367 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:26.937332 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427a5d5c_7dc1_4991_b731_2a70b934aa64.slice/crio-f845223ac4ffd10687d1f10c504293ada82911ce6b26f9fbdcf23595c1328cc8 WatchSource:0}: Error finding container f845223ac4ffd10687d1f10c504293ada82911ce6b26f9fbdcf23595c1328cc8: Status 404 returned error can't find the container with id f845223ac4ffd10687d1f10c504293ada82911ce6b26f9fbdcf23595c1328cc8 Jun 09 15:04:26.952022 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:26.951973 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc"] Jun 09 15:04:26.958669 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:26.958634 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08abd51a_152c_4463_9f43_5be3545ccefc.slice/crio-f7ab4852560b04875a5b727aaa7985361d70a92445605acb98d0a8db9b72693b WatchSource:0}: Error finding container f7ab4852560b04875a5b727aaa7985361d70a92445605acb98d0a8db9b72693b: Status 404 returned error can't find the container with id f7ab4852560b04875a5b727aaa7985361d70a92445605acb98d0a8db9b72693b Jun 09 15:04:27.030554 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.030523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-ftck8"] Jun 09 15:04:27.034611 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:27.034580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44791603_2b8f_4b33_bc0b_c920bc34cb1f.slice/crio-a60bceb94a9c2b43751dc441ff564695676db12345c1622ac69a33a2ebacd1fc WatchSource:0}: Error finding container a60bceb94a9c2b43751dc441ff564695676db12345c1622ac69a33a2ebacd1fc: Status 404 returned error can't find the container with id a60bceb94a9c2b43751dc441ff564695676db12345c1622ac69a33a2ebacd1fc Jun 09 15:04:27.226343 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.226298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:27.226518 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:27.226443 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:27.226518 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:27.226509 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.226494441 +0000 UTC m=+214.856697659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:27.544575 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.544545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" event={"ID":"427a5d5c-7dc1-4991-b731-2a70b934aa64","Type":"ContainerStarted","Data":"f845223ac4ffd10687d1f10c504293ada82911ce6b26f9fbdcf23595c1328cc8"} Jun 09 15:04:27.545586 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.545564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ftck8" event={"ID":"44791603-2b8f-4b33-bc0b-c920bc34cb1f","Type":"ContainerStarted","Data":"a60bceb94a9c2b43751dc441ff564695676db12345c1622ac69a33a2ebacd1fc"} Jun 09 15:04:27.551069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.551041 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" event={"ID":"08abd51a-152c-4463-9f43-5be3545ccefc","Type":"ContainerStarted","Data":"22145f9afb88b794a427532b8c22d91b6141f01f94cce1441ddf0dfe10d7ef84"} Jun 09 15:04:27.551243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.551117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" event={"ID":"08abd51a-152c-4463-9f43-5be3545ccefc","Type":"ContainerStarted","Data":"f7ab4852560b04875a5b727aaa7985361d70a92445605acb98d0a8db9b72693b"} Jun 09 15:04:27.567481 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:27.567413 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-v29gc" podStartSLOduration=1.567393934 podStartE2EDuration="1.567393934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:27.565994066 +0000 UTC m=+214.196197307" watchObservedRunningTime="2026-06-09 15:04:27.567393934 +0000 UTC m=+214.197597152" Jun 09 15:04:28.232900 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:28.232864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:28.233072 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:28.233049 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:28.233136 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:28.233128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.233105328 +0000 UTC m=+216.863308553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:30.247930 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:30.247876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:30.248402 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:30.248051 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:30.248402 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:30.248119 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.248098636 +0000 UTC m=+220.878301876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:30.562532 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:30.562430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" event={"ID":"427a5d5c-7dc1-4991-b731-2a70b934aa64","Type":"ContainerStarted","Data":"1133d9f6611e8f6c6562d1cbace55bf9972b249acdcced9525e9d0c58d88c464"} Jun 09 15:04:30.564034 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:30.564002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ftck8" event={"ID":"44791603-2b8f-4b33-bc0b-c920bc34cb1f","Type":"ContainerStarted","Data":"fd3eee88e10ec34929dae18d275c124d197480da8b2d6da3f7c09fad4bf52fd7"} Jun 09 15:04:30.581736 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:30.581669 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" podStartSLOduration=1.21531003 podStartE2EDuration="4.581649704s" totalImagesPullingTime="3.366339674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:30.580438818 +0000 UTC m=+217.210642057" watchObservedRunningTime="2026-06-09 15:04:30.581649704 +0000 UTC m=+217.211852945" Jun 09 15:04:30.596790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:30.596731 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-ftck8" podStartSLOduration=1.965394328 podStartE2EDuration="4.596713142s" totalImagesPullingTime="2.631318814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:30.595655578 +0000 UTC m=+217.225858819" watchObservedRunningTime="2026-06-09 15:04:30.596713142 +0000 UTC m=+217.226916382" Jun 09 15:04:32.995295 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:32.995265 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrdfn_8ee049a3-ac31-42dd-aec3-ae7044f01c66/dns-node-resolver/0.log" Jun 09 15:04:33.795506 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:33.795477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4lzw_dd337ebb-9c52-4890-adb4-0645c3b2b784/node-ca/0.log" Jun 09 15:04:34.282641 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.282588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:34.283019 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:34.282726 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:34.283019 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:34.282806 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.28279019 +0000 UTC m=+228.912993409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:34.586465 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.586385 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9kqd7"] Jun 09 15:04:34.588504 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.588487 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.590949 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.590922 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 15:04:34.590949 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.590923 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 15:04:34.591919 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.591899 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 15:04:34.591919 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.591913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xtslx\"" Jun 09 15:04:34.592085 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.591959 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 15:04:34.598137 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.598119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cf2d_48761377-1856-4b2d-875c-c9e706bd9f8f/serve-healthcheck-canary/0.log" Jun 09 15:04:34.598474 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.598454 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9kqd7"] Jun 09 15:04:34.684393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.684358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7078c737-83a9-4e60-8622-0370837b345d-signing-key\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.684573 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.684409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7078c737-83a9-4e60-8622-0370837b345d-signing-cabundle\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.684573 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.684515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwkn\" (UniqueName: \"kubernetes.io/projected/7078c737-83a9-4e60-8622-0370837b345d-kube-api-access-htwkn\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.784997 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.784959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htwkn\" (UniqueName: \"kubernetes.io/projected/7078c737-83a9-4e60-8622-0370837b345d-kube-api-access-htwkn\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.785156 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.785011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7078c737-83a9-4e60-8622-0370837b345d-signing-key\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.785156 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.785041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7078c737-83a9-4e60-8622-0370837b345d-signing-cabundle\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.785638 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.785622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7078c737-83a9-4e60-8622-0370837b345d-signing-cabundle\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.787432 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.787411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7078c737-83a9-4e60-8622-0370837b345d-signing-key\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.793753 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.793728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwkn\" (UniqueName: \"kubernetes.io/projected/7078c737-83a9-4e60-8622-0370837b345d-kube-api-access-htwkn\") pod \"service-ca-7d74d578b8-9kqd7\" (UID: \"7078c737-83a9-4e60-8622-0370837b345d\") " pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:34.897805 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:34.897756 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" Jun 09 15:04:35.023744 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:35.023713 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9kqd7"] Jun 09 15:04:35.027222 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:35.027179 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7078c737_83a9_4e60_8622_0370837b345d.slice/crio-c9e95e4c8fb7bd427d91e77284b219e660b52424529e0107a5650f361d2737bf WatchSource:0}: Error finding container c9e95e4c8fb7bd427d91e77284b219e660b52424529e0107a5650f361d2737bf: Status 404 returned error can't find the container with id c9e95e4c8fb7bd427d91e77284b219e660b52424529e0107a5650f361d2737bf Jun 09 15:04:35.579531 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:35.579491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" event={"ID":"7078c737-83a9-4e60-8622-0370837b345d","Type":"ContainerStarted","Data":"c9e95e4c8fb7bd427d91e77284b219e660b52424529e0107a5650f361d2737bf"} Jun 09 15:04:37.587372 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:37.587334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" event={"ID":"7078c737-83a9-4e60-8622-0370837b345d","Type":"ContainerStarted","Data":"114040e60915159bb502577a66cd847fdd70514413abdc846d8228356f103477"} Jun 09 15:04:37.602193 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:37.602122 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-9kqd7" podStartSLOduration=1.551084646 podStartE2EDuration="3.602101629s" totalImagesPullingTime="2.051016983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:37.601883693 +0000 UTC m=+224.232086930" watchObservedRunningTime="2026-06-09 15:04:37.602101629 +0000 UTC m=+224.232304871" Jun 09 15:04:42.346774 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:42.346733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:42.347220 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:42.346857 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:42.347220 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:04:42.346917 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls podName:e58479b6-83db-4c20-91fd-f0d378e402b4 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:58.346904221 +0000 UTC m=+244.977107439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-svf78" (UID: "e58479b6-83db-4c20-91fd-f0d378e402b4") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:04:56.005763 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.005724 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mnrwb"] Jun 09 15:04:56.007694 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.007677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.012106 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.012080 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qhg89\"" Jun 09 15:04:56.012270 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.012127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:04:56.012270 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.012127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:04:56.020022 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.019997 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mnrwb"] Jun 09 15:04:56.153253 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.153216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c831c0-d884-4b22-af79-b93edddf0ad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.153253 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.153263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.153482 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.153335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrxd\" (UniqueName: \"kubernetes.io/projected/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-api-access-9mrxd\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.153482 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.153413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c831c0-d884-4b22-af79-b93edddf0ad5-data-volume\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.153482 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.153471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c831c0-d884-4b22-af79-b93edddf0ad5-crio-socket\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.253951 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.253919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c831c0-d884-4b22-af79-b93edddf0ad5-data-volume\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254203 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.253973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c831c0-d884-4b22-af79-b93edddf0ad5-crio-socket\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254203 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c831c0-d884-4b22-af79-b93edddf0ad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254203 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254203 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254072 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c831c0-d884-4b22-af79-b93edddf0ad5-crio-socket\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254203 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrxd\" (UniqueName: \"kubernetes.io/projected/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-api-access-9mrxd\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254468 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c831c0-d884-4b22-af79-b93edddf0ad5-data-volume\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.254685 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.254665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.256600 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.256554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c831c0-d884-4b22-af79-b93edddf0ad5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.263269 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.263233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrxd\" (UniqueName: \"kubernetes.io/projected/e3c831c0-d884-4b22-af79-b93edddf0ad5-kube-api-access-9mrxd\") pod \"insights-runtime-extractor-mnrwb\" (UID: \"e3c831c0-d884-4b22-af79-b93edddf0ad5\") " pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.317199 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.317141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mnrwb" Jun 09 15:04:56.446226 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.446195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mnrwb"] Jun 09 15:04:56.449345 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:56.449316 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c831c0_d884_4b22_af79_b93edddf0ad5.slice/crio-8484ce089713b497160ed1700d680a1729da43f1f9a595d501b30051fc28a1d4 WatchSource:0}: Error finding container 8484ce089713b497160ed1700d680a1729da43f1f9a595d501b30051fc28a1d4: Status 404 returned error can't find the container with id 8484ce089713b497160ed1700d680a1729da43f1f9a595d501b30051fc28a1d4 Jun 09 15:04:56.647985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.647947 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnrwb" event={"ID":"e3c831c0-d884-4b22-af79-b93edddf0ad5","Type":"ContainerStarted","Data":"3bf7eeff61e3dbcf150e010d3aedc63cebb9d97c2b703d3ab1b277e619f736bf"} Jun 09 15:04:56.648156 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:56.648006 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnrwb" event={"ID":"e3c831c0-d884-4b22-af79-b93edddf0ad5","Type":"ContainerStarted","Data":"8484ce089713b497160ed1700d680a1729da43f1f9a595d501b30051fc28a1d4"} Jun 09 15:04:57.654011 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:57.653971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnrwb" event={"ID":"e3c831c0-d884-4b22-af79-b93edddf0ad5","Type":"ContainerStarted","Data":"0c2f12ea4de9a015115c50b9867af7e45a7f334b24ec26190169095c932caacb"} Jun 09 15:04:58.372678 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.372626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:58.375340 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.375309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e58479b6-83db-4c20-91fd-f0d378e402b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-svf78\" (UID: \"e58479b6-83db-4c20-91fd-f0d378e402b4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:58.610764 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.610741 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbkjm\"" Jun 09 15:04:58.619361 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.619330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" Jun 09 15:04:58.660066 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.660026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnrwb" event={"ID":"e3c831c0-d884-4b22-af79-b93edddf0ad5","Type":"ContainerStarted","Data":"07c07ce06257f2f971aee22fcdf34911ae0a5e9e922a4e5fdc90ea91c6915161"} Jun 09 15:04:58.679773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.679725 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mnrwb" podStartSLOduration=1.689090228 podStartE2EDuration="3.679706492s" totalImagesPullingTime="1.990616264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:04:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:58.677464218 +0000 UTC m=+245.307667465" watchObservedRunningTime="2026-06-09 15:04:58.679706492 +0000 UTC m=+245.309909731" Jun 09 15:04:58.749317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:58.749287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78"] Jun 09 15:04:58.752487 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:04:58.752457 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58479b6_83db_4c20_91fd_f0d378e402b4.slice/crio-913ec6c652bcaadf03e9051d289efe904bb510bd5a8b340fdf63ba0a5c008cf7 WatchSource:0}: Error finding container 913ec6c652bcaadf03e9051d289efe904bb510bd5a8b340fdf63ba0a5c008cf7: Status 404 returned error can't find the container with id 913ec6c652bcaadf03e9051d289efe904bb510bd5a8b340fdf63ba0a5c008cf7 Jun 09 15:04:59.664399 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:04:59.664358 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" event={"ID":"e58479b6-83db-4c20-91fd-f0d378e402b4","Type":"ContainerStarted","Data":"913ec6c652bcaadf03e9051d289efe904bb510bd5a8b340fdf63ba0a5c008cf7"} Jun 09 15:05:01.284143 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.284105 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx"] Jun 09 15:05:01.287401 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.287378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:01.291411 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.291387 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k9qz7\"" Jun 09 15:05:01.291572 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.291419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 15:05:01.299886 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.299854 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx"] Jun 09 15:05:01.399696 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.399651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-stffx\" (UID: \"1797c1ba-16f5-403c-b197-33ca2ae47069\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:01.501145 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.501097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-stffx\" (UID: \"1797c1ba-16f5-403c-b197-33ca2ae47069\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:01.501382 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:01.501269 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 15:05:01.501382 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:01.501333 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates podName:1797c1ba-16f5-403c-b197-33ca2ae47069 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:02.001318373 +0000 UTC m=+248.631521591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-stffx" (UID: "1797c1ba-16f5-403c-b197-33ca2ae47069") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 15:05:01.673281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.673242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" event={"ID":"e58479b6-83db-4c20-91fd-f0d378e402b4","Type":"ContainerStarted","Data":"81fc461a49089d2761fea4d733726167e5c988f9f58f8137b5edad894e46788c"} Jun 09 15:05:01.692404 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:01.692344 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" podStartSLOduration=33.657832292 podStartE2EDuration="35.69232255s" totalImagesPullingTime="2.034490258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:01.691285016 +0000 UTC m=+248.321488254" watchObservedRunningTime="2026-06-09 15:05:01.69232255 +0000 UTC m=+248.322525795" Jun 09 15:05:02.004594 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:02.004488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-stffx\" (UID: \"1797c1ba-16f5-403c-b197-33ca2ae47069\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:02.006996 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:02.006967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1797c1ba-16f5-403c-b197-33ca2ae47069-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-stffx\" (UID: \"1797c1ba-16f5-403c-b197-33ca2ae47069\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:02.197343 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:02.197300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:02.364629 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:02.364594 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx"] Jun 09 15:05:02.368895 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:02.368866 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1797c1ba_16f5_403c_b197_33ca2ae47069.slice/crio-cfc61a8e974dce991f5a4fd43689a11575b3573f3b6c7f28876891e82ef90b55 WatchSource:0}: Error finding container cfc61a8e974dce991f5a4fd43689a11575b3573f3b6c7f28876891e82ef90b55: Status 404 returned error can't find the container with id cfc61a8e974dce991f5a4fd43689a11575b3573f3b6c7f28876891e82ef90b55 Jun 09 15:05:02.677587 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:02.677551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" event={"ID":"1797c1ba-16f5-403c-b197-33ca2ae47069","Type":"ContainerStarted","Data":"cfc61a8e974dce991f5a4fd43689a11575b3573f3b6c7f28876891e82ef90b55"} Jun 09 15:05:03.685610 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:03.685569 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" event={"ID":"1797c1ba-16f5-403c-b197-33ca2ae47069","Type":"ContainerStarted","Data":"9bda45dbac689bd9283f8c5d959df9898b5bfc387000585ea9759836bc99c78d"} Jun 09 15:05:03.686098 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:03.685738 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:03.690395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:03.690368 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" Jun 09 15:05:03.701390 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:03.701336 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-stffx" podStartSLOduration=1.761031618 podStartE2EDuration="2.701320116s" totalImagesPullingTime="940.288498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:03.70045783 +0000 UTC m=+250.330661070" watchObservedRunningTime="2026-06-09 15:05:03.701320116 +0000 UTC m=+250.331523356" Jun 09 15:05:05.729221 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:05.729156 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:05:05.731502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:05.731479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96d6550e-0be0-4b01-bac3-dac2924a6f04-metrics-certs\") pod \"network-metrics-daemon-vnw84\" (UID: \"96d6550e-0be0-4b01-bac3-dac2924a6f04\") " pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:05:05.840268 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:05.840221 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x45km\"" Jun 09 15:05:05.848775 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:05.848718 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vnw84" Jun 09 15:05:05.976608 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:05.976576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vnw84"] Jun 09 15:05:05.980014 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:05.979950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d6550e_0be0_4b01_bac3_dac2924a6f04.slice/crio-ec62c1ee054f0b6ecbfd97c8d933ed1351800a02e310068d0aa10caaef451438 WatchSource:0}: Error finding container ec62c1ee054f0b6ecbfd97c8d933ed1351800a02e310068d0aa10caaef451438: Status 404 returned error can't find the container with id ec62c1ee054f0b6ecbfd97c8d933ed1351800a02e310068d0aa10caaef451438 Jun 09 15:05:06.696409 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:06.696369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vnw84" event={"ID":"96d6550e-0be0-4b01-bac3-dac2924a6f04","Type":"ContainerStarted","Data":"ec62c1ee054f0b6ecbfd97c8d933ed1351800a02e310068d0aa10caaef451438"} Jun 09 15:05:07.701048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:07.701011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vnw84" event={"ID":"96d6550e-0be0-4b01-bac3-dac2924a6f04","Type":"ContainerStarted","Data":"83a351a6acc16612daee7b4d7d8efea4d14921564bfb8f115448410b347bd7e7"} Jun 09 15:05:07.701521 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:07.701065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vnw84" event={"ID":"96d6550e-0be0-4b01-bac3-dac2924a6f04","Type":"ContainerStarted","Data":"dc662e067bd61c73f903f980331a84efb0cab4623a087cc430631e4b70ab429d"} Jun 09 15:05:07.719842 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:07.719787 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vnw84" podStartSLOduration=253.91118229 podStartE2EDuration="4m14.719769789s" totalImagesPullingTime="808.587499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:07.719115161 +0000 UTC m=+254.349318401" watchObservedRunningTime="2026-06-09 15:05:07.719769789 +0000 UTC m=+254.349973028" Jun 09 15:05:09.708804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:09.708728 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:09.708804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:09.708767 2563 generic.go:356] "Generic (PLEG): container finished" podID="e58479b6-83db-4c20-91fd-f0d378e402b4" containerID="81fc461a49089d2761fea4d733726167e5c988f9f58f8137b5edad894e46788c" exitCode=2 Jun 09 15:05:09.709215 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:09.708819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" event={"ID":"e58479b6-83db-4c20-91fd-f0d378e402b4","Type":"ContainerDied","Data":"81fc461a49089d2761fea4d733726167e5c988f9f58f8137b5edad894e46788c"} Jun 09 15:05:09.709215 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:09.709112 2563 scope.go:117] "RemoveContainer" containerID="81fc461a49089d2761fea4d733726167e5c988f9f58f8137b5edad894e46788c" Jun 09 15:05:10.714438 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:10.714410 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:10.714794 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:10.714486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-svf78" event={"ID":"e58479b6-83db-4c20-91fd-f0d378e402b4","Type":"ContainerStarted","Data":"4d9945be914dc8c2f46beb0a27d58acb4bbc8bbf4b24ea9573626db24a0b9089"} Jun 09 15:05:13.292534 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.292447 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts"] Jun 09 15:05:13.295280 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.295259 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.298073 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.298054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 15:05:13.299322 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.299290 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:05:13.299436 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.299335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 15:05:13.299436 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.299343 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8hmcx\"" Jun 09 15:05:13.306902 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.306879 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts"] Jun 09 15:05:13.388932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.388892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.389152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.388951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppt6t\" (UniqueName: \"kubernetes.io/projected/bd0af667-3455-4aec-a122-f5bd6773bc6a-kube-api-access-ppt6t\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.389152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.389065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.389152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.389099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0af667-3455-4aec-a122-f5bd6773bc6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.417950 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.417908 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp"] Jun 09 15:05:13.421549 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.421527 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.424332 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.424307 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 15:05:13.424549 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.424308 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 15:05:13.424830 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.424806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wtsfg\"" Jun 09 15:05:13.424985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.424942 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 15:05:13.431830 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.431805 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp"] Jun 09 15:05:13.439828 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.439799 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kkv8v"] Jun 09 15:05:13.442983 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.442966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.445493 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.445467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:05:13.445863 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.445828 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4m2mf\"" Jun 09 15:05:13.445863 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.445847 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:05:13.445863 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.445828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:05:13.489714 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.489714 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-sys\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppt6t\" (UniqueName: \"kubernetes.io/projected/bd0af667-3455-4aec-a122-f5bd6773bc6a-kube-api-access-ppt6t\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/865ba19a-915d-4c21-9bd1-25f567b13c79-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-wtmp\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.489984 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-266sf\" (UniqueName: \"kubernetes.io/projected/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-api-access-266sf\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.489993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-textfile\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-metrics-client-ca\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zcs\" (UniqueName: \"kubernetes.io/projected/480ce491-cdb3-4cc0-9417-e7d918412858-kube-api-access-78zcs\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0af667-3455-4aec-a122-f5bd6773bc6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.490368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.490319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-root\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.491362 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.491337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0af667-3455-4aec-a122-f5bd6773bc6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.492922 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.492879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.493121 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.493099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0af667-3455-4aec-a122-f5bd6773bc6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.499817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.499788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppt6t\" (UniqueName: \"kubernetes.io/projected/bd0af667-3455-4aec-a122-f5bd6773bc6a-kube-api-access-ppt6t\") pod \"openshift-state-metrics-65f78d5c66-xrhts\" (UID: \"bd0af667-3455-4aec-a122-f5bd6773bc6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.591144 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78zcs\" (UniqueName: \"kubernetes.io/projected/480ce491-cdb3-4cc0-9417-e7d918412858-kube-api-access-78zcs\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-root\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-sys\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/865ba19a-915d-4c21-9bd1-25f567b13c79-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-wtmp\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:13.591356 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 15:05:13.591368 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:13.591371 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-sys\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:13.591426 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls podName:480ce491-cdb3-4cc0-9417-e7d918412858 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:14.091405164 +0000 UTC m=+260.721608384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls") pod "node-exporter-kkv8v" (UID: "480ce491-cdb3-4cc0-9417-e7d918412858") : secret "node-exporter-tls" not found Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-wtmp\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:13.591577 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls podName:865ba19a-915d-4c21-9bd1-25f567b13c79 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:14.091560241 +0000 UTC m=+260.721763472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-tnrzp" (UID: "865ba19a-915d-4c21-9bd1-25f567b13c79") : secret "kube-state-metrics-tls" not found Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-266sf\" (UniqueName: \"kubernetes.io/projected/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-api-access-266sf\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.591804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-textfile\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-metrics-client-ca\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.591969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-textfile\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.592559 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.592559 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592559 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/865ba19a-915d-4c21-9bd1-25f567b13c79-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.592559 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/480ce491-cdb3-4cc0-9417-e7d918412858-metrics-client-ca\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.592699 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.592575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/480ce491-cdb3-4cc0-9417-e7d918412858-root\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.594363 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.594343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.594676 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.594659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.601188 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.601003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zcs\" (UniqueName: \"kubernetes.io/projected/480ce491-cdb3-4cc0-9417-e7d918412858-kube-api-access-78zcs\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:13.601188 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.601112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-266sf\" (UniqueName: \"kubernetes.io/projected/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-api-access-266sf\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:13.604577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.604553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" Jun 09 15:05:13.764963 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:13.764929 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts"] Jun 09 15:05:13.768634 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:13.768592 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0af667_3455_4aec_a122_f5bd6773bc6a.slice/crio-e0fcd49bfee76e8d403754473a379fa6800d7a529b11da9197e25ae830a2f935 WatchSource:0}: Error finding container e0fcd49bfee76e8d403754473a379fa6800d7a529b11da9197e25ae830a2f935: Status 404 returned error can't find the container with id e0fcd49bfee76e8d403754473a379fa6800d7a529b11da9197e25ae830a2f935 Jun 09 15:05:14.095873 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.095780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:14.095873 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.095830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:14.096057 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:14.095936 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 15:05:14.096057 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:14.096002 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls podName:480ce491-cdb3-4cc0-9417-e7d918412858 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:15.095986889 +0000 UTC m=+261.726190107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls") pod "node-exporter-kkv8v" (UID: "480ce491-cdb3-4cc0-9417-e7d918412858") : secret "node-exporter-tls" not found Jun 09 15:05:14.098278 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.098248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/865ba19a-915d-4c21-9bd1-25f567b13c79-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-tnrzp\" (UID: \"865ba19a-915d-4c21-9bd1-25f567b13c79\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:14.332333 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.332267 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" Jun 09 15:05:14.446882 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.446851 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:05:14.450959 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.450935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.454429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.454391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ns2hc\"" Jun 09 15:05:14.454715 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.454698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 15:05:14.455047 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.455030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 15:05:14.455310 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.455287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 15:05:14.455531 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.455516 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 15:05:14.455777 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.455761 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 15:05:14.456023 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.455941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 15:05:14.456271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.456197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 15:05:14.456271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.456205 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 15:05:14.456477 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.456451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 15:05:14.470319 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.470124 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:05:14.500893 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.500851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.500909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.500971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkjt\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.501628 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.501357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.508122 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.507403 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp"] Jun 09 15:05:14.602274 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602274 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602274 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkjt\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.602854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.602826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.603097 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:14.602905 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle podName:98431df6-48be-44bf-994f-352b7a78c01c nodeName:}" failed. No retries permitted until 2026-06-09 15:05:15.102884346 +0000 UTC m=+261.733087584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "98431df6-48be-44bf-994f-352b7a78c01c") : configmap references non-existent config key: ca-bundle.crt Jun 09 15:05:14.603185 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:14.603126 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 15:05:14.603254 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:14.603203 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls podName:98431df6-48be-44bf-994f-352b7a78c01c nodeName:}" failed. No retries permitted until 2026-06-09 15:05:15.103185304 +0000 UTC m=+261.733388528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "98431df6-48be-44bf-994f-352b7a78c01c") : secret "alertmanager-main-tls" not found Jun 09 15:05:14.603708 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.603679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.605546 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.605493 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.606242 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.605884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.606242 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.606079 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.606484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.606321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.606936 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.606910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.607126 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.607105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.607239 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.607192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.607757 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.607734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.611364 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.611340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkjt\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:14.731545 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.731504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" event={"ID":"bd0af667-3455-4aec-a122-f5bd6773bc6a","Type":"ContainerStarted","Data":"586143dfda01dffa625b3144d8e49b2ff29c829d7fb0979b5e7525b568d9f67f"} Jun 09 15:05:14.731732 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.731575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" event={"ID":"bd0af667-3455-4aec-a122-f5bd6773bc6a","Type":"ContainerStarted","Data":"89567a55f2ffc3dc09828bd54b8adc89e892f59feabbca696f6fc9b831958312"} Jun 09 15:05:14.731732 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.731605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" event={"ID":"bd0af667-3455-4aec-a122-f5bd6773bc6a","Type":"ContainerStarted","Data":"e0fcd49bfee76e8d403754473a379fa6800d7a529b11da9197e25ae830a2f935"} Jun 09 15:05:14.732996 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:14.732961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" event={"ID":"865ba19a-915d-4c21-9bd1-25f567b13c79","Type":"ContainerStarted","Data":"a91091e0a5848b8a6f11a233e9691f6edb0a0e783bb8c6280de9c535feeee564"} Jun 09 15:05:15.107398 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.107355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:15.107597 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.107413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:15.107597 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.107451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:15.108248 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.108225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:15.109788 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.109769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/480ce491-cdb3-4cc0-9417-e7d918412858-node-exporter-tls\") pod \"node-exporter-kkv8v\" (UID: \"480ce491-cdb3-4cc0-9417-e7d918412858\") " pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:15.109894 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.109875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:15.253568 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.253476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkv8v" Jun 09 15:05:15.265672 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:15.265635 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480ce491_cdb3_4cc0_9417_e7d918412858.slice/crio-d41a4f93e9c2348ceedace301030e80e1f9a0a06069c8ae0ba8b3266ba9ef0f7 WatchSource:0}: Error finding container d41a4f93e9c2348ceedace301030e80e1f9a0a06069c8ae0ba8b3266ba9ef0f7: Status 404 returned error can't find the container with id d41a4f93e9c2348ceedace301030e80e1f9a0a06069c8ae0ba8b3266ba9ef0f7 Jun 09 15:05:15.370429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.370393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:05:15.547451 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.545018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:05:15.738234 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.738195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv8v" event={"ID":"480ce491-cdb3-4cc0-9417-e7d918412858","Type":"ContainerStarted","Data":"d41a4f93e9c2348ceedace301030e80e1f9a0a06069c8ae0ba8b3266ba9ef0f7"} Jun 09 15:05:15.740544 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.740514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" event={"ID":"bd0af667-3455-4aec-a122-f5bd6773bc6a","Type":"ContainerStarted","Data":"616e18f799fcaba5671077f9daaf0b02c3e2712a7a61f5f37106f51389aba24c"} Jun 09 15:05:15.759421 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:15.759360 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xrhts" podStartSLOduration=1.7046969220000001 podStartE2EDuration="2.759342408s" totalImagesPullingTime="1.054645486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:15.757992725 +0000 UTC m=+262.388195968" watchObservedRunningTime="2026-06-09 15:05:15.759342408 +0000 UTC m=+262.389545648" Jun 09 15:05:15.803417 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:15.803333 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98431df6_48be_44bf_994f_352b7a78c01c.slice/crio-6969d2c73d640cfc5e0b7b083a250b4b906878d31c69ba6f830a5e8170cbba90 WatchSource:0}: Error finding container 6969d2c73d640cfc5e0b7b083a250b4b906878d31c69ba6f830a5e8170cbba90: Status 404 returned error can't find the container with id 6969d2c73d640cfc5e0b7b083a250b4b906878d31c69ba6f830a5e8170cbba90 Jun 09 15:05:16.747576 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.747500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" event={"ID":"865ba19a-915d-4c21-9bd1-25f567b13c79","Type":"ContainerStarted","Data":"786034cbca9668f7e3fee8b8195f0a3e4b9787c83208b435f6b2afe8307b59de"} Jun 09 15:05:16.747576 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.747570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" event={"ID":"865ba19a-915d-4c21-9bd1-25f567b13c79","Type":"ContainerStarted","Data":"7f0ebef5d36dcc4121c87d8672511cc3018422cd92d5b3b13572cba425741ab3"} Jun 09 15:05:16.748092 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.747599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" event={"ID":"865ba19a-915d-4c21-9bd1-25f567b13c79","Type":"ContainerStarted","Data":"26cf094654430d1100328daad8a91c547c9374c3a8ebc77efa18a6fed6907913"} Jun 09 15:05:16.749409 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.749375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv8v" event={"ID":"480ce491-cdb3-4cc0-9417-e7d918412858","Type":"ContainerStarted","Data":"09126d77f42773b5f1120f7c3669bc5a9dd95b1177666e8410070ef306e72782"} Jun 09 15:05:16.750685 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.750658 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"6969d2c73d640cfc5e0b7b083a250b4b906878d31c69ba6f830a5e8170cbba90"} Jun 09 15:05:16.767628 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:16.767577 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-tnrzp" podStartSLOduration=2.427289765 podStartE2EDuration="3.767556824s" totalImagesPullingTime="1.340267059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:16.766512059 +0000 UTC m=+263.396715300" watchObservedRunningTime="2026-06-09 15:05:16.767556824 +0000 UTC m=+263.397760069" Jun 09 15:05:17.756215 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:17.756151 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25" exitCode=0 Jun 09 15:05:17.756215 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:17.756207 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25"} Jun 09 15:05:17.757852 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:17.757822 2563 generic.go:356] "Generic (PLEG): container finished" podID="480ce491-cdb3-4cc0-9417-e7d918412858" containerID="09126d77f42773b5f1120f7c3669bc5a9dd95b1177666e8410070ef306e72782" exitCode=0 Jun 09 15:05:17.757927 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:17.757906 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv8v" event={"ID":"480ce491-cdb3-4cc0-9417-e7d918412858","Type":"ContainerDied","Data":"09126d77f42773b5f1120f7c3669bc5a9dd95b1177666e8410070ef306e72782"} Jun 09 15:05:18.598543 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.598503 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68bcdcf89b-x924p"] Jun 09 15:05:18.602040 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.602011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.605896 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.605312 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 15:05:18.605896 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.605551 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 15:05:18.609734 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.607358 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 15:05:18.609734 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.607555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 15:05:18.609734 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.607560 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 15:05:18.610598 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.610573 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l4clj\"" Jun 09 15:05:18.617065 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.617036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 15:05:18.617271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.617125 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68bcdcf89b-x924p"] Jun 09 15:05:18.639880 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.639842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640057 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.639895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640057 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.639952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-serving-certs-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640057 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.639984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-federate-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640249 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.640091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-metrics-client-ca\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640249 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.640129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjztc\" (UniqueName: \"kubernetes.io/projected/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-kube-api-access-xjztc\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640249 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.640157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.640249 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.640221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741611 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741611 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-serving-certs-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-federate-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-metrics-client-ca\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjztc\" (UniqueName: \"kubernetes.io/projected/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-kube-api-access-xjztc\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.741838 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.741807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.742570 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.742535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-metrics-client-ca\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.742705 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.742544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-serving-certs-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.742766 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.742726 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.744418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.744387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.744530 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.744392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-telemeter-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.744655 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.744630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.744720 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.744701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-federate-client-tls\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.750712 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.750682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjztc\" (UniqueName: \"kubernetes.io/projected/92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af-kube-api-access-xjztc\") pod \"telemeter-client-68bcdcf89b-x924p\" (UID: \"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af\") " pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:18.764653 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.764620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv8v" event={"ID":"480ce491-cdb3-4cc0-9417-e7d918412858","Type":"ContainerStarted","Data":"0fb144456cb5e9103e101fc2c99b31b16ee5150cb5e174bc7513ae9a5f65bfd9"} Jun 09 15:05:18.765059 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.764688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv8v" event={"ID":"480ce491-cdb3-4cc0-9417-e7d918412858","Type":"ContainerStarted","Data":"7217304adad7f33750aaad52996a189a09d1c2437c0647bc8919dfabb0f7e9ac"} Jun 09 15:05:18.785465 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.785403 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kkv8v" podStartSLOduration=4.418498854 podStartE2EDuration="5.785384016s" totalImagesPullingTime="1.286951827s" totalInitContainerRuntime="79.933335ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:18.784021304 +0000 UTC m=+265.414224544" watchObservedRunningTime="2026-06-09 15:05:18.785384016 +0000 UTC m=+265.415587255" Jun 09 15:05:18.915775 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:18.915681 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" Jun 09 15:05:19.080044 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.080005 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68bcdcf89b-x924p"] Jun 09 15:05:19.084937 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:19.084904 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a89e6a_98f1_4b6d_a39f_d4d5d87ba1af.slice/crio-b01de1ba72f1051ed90c83efbf66bb6220b70b279ae6c68c715eb2d18a0f7f56 WatchSource:0}: Error finding container b01de1ba72f1051ed90c83efbf66bb6220b70b279ae6c68c715eb2d18a0f7f56: Status 404 returned error can't find the container with id b01de1ba72f1051ed90c83efbf66bb6220b70b279ae6c68c715eb2d18a0f7f56 Jun 09 15:05:19.705570 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.705537 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:05:19.710590 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.710565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.713434 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 15:05:19.713434 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 15:05:19.713434 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713400 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:05:19.713749 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713732 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 15:05:19.713749 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713740 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 15:05:19.713871 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.713770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 15:05:19.714910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 15:05:19.714910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 15:05:19.715048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714916 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 15:05:19.715048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714890 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 15:05:19.715048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 15:05:19.715048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 15:05:19.715048 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.714984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tmcqc\"" Jun 09 15:05:19.715300 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.715063 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 15:05:19.715380 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.715364 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2jsgqc1kqvgrg\"" Jun 09 15:05:19.717856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.717833 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 15:05:19.719695 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.719678 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 15:05:19.729964 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.729926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:05:19.750874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.750848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.750874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.750879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.750967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8dvk\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.751707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.751540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.771117 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.771087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980"} Jun 09 15:05:19.771541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.771173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e"} Jun 09 15:05:19.772100 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.772083 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" event={"ID":"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af","Type":"ContainerStarted","Data":"b01de1ba72f1051ed90c83efbf66bb6220b70b279ae6c68c715eb2d18a0f7f56"} Jun 09 15:05:19.852892 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.852861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.853027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.852909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.853027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.852927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.853027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.852953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.853027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.852978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.853027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dvk\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853982 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.854502 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.855070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.854710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.855070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.857779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.857988 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.853992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.858772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.858804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.858830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.858894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.858939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859341 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.859021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.859847 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.859442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.860539 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.860515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.860852 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.860824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.860953 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.860905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.861473 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.861413 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.861565 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.861525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.861738 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.861705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.862474 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.862288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.862474 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.862434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.862832 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.862789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.863268 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.863245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.865270 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.865222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8dvk\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:19.865851 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:19.865811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:20.033526 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.033483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:20.186565 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.186525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:05:20.189345 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:20.189318 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f328ab_e9ea_4074_8c14_41d747022909.slice/crio-15660637e5f44c9c124ddbcf0d4e1ee605d12d57e0fc61b3934fe25119cc5f60 WatchSource:0}: Error finding container 15660637e5f44c9c124ddbcf0d4e1ee605d12d57e0fc61b3934fe25119cc5f60: Status 404 returned error can't find the container with id 15660637e5f44c9c124ddbcf0d4e1ee605d12d57e0fc61b3934fe25119cc5f60 Jun 09 15:05:20.778821 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.778780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a"} Jun 09 15:05:20.779259 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.778866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e"} Jun 09 15:05:20.779259 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.778905 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da"} Jun 09 15:05:20.779259 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.778944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerStarted","Data":"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858"} Jun 09 15:05:20.780273 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.780240 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="1d5340160f96434da8154e83a8f56fe3b291cf9df86fc33b3ae239b929e80eb4" exitCode=0 Jun 09 15:05:20.780371 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.780307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"1d5340160f96434da8154e83a8f56fe3b291cf9df86fc33b3ae239b929e80eb4"} Jun 09 15:05:20.780371 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.780366 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"15660637e5f44c9c124ddbcf0d4e1ee605d12d57e0fc61b3934fe25119cc5f60"} Jun 09 15:05:20.807353 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:20.807301 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.190619546 podStartE2EDuration="6.80728155s" totalImagesPullingTime="3.601607428s" totalInitContainerRuntime="15.054576ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:20.804708544 +0000 UTC m=+267.434911784" watchObservedRunningTime="2026-06-09 15:05:20.80728155 +0000 UTC m=+267.437484790" Jun 09 15:05:21.787762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:21.787664 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" event={"ID":"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af","Type":"ContainerStarted","Data":"697ad9042c03aa2a93fe7198c32d1b5c9c4a785a33d80fd7d3c304db16033279"} Jun 09 15:05:21.787762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:21.787738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" event={"ID":"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af","Type":"ContainerStarted","Data":"576f64ed9a64658536e606c3066bb2b7dafb3f4908e87f97ae119373c1bf8b87"} Jun 09 15:05:21.788369 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:21.787766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" event={"ID":"92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af","Type":"ContainerStarted","Data":"629d055e9cd10232d89e61935a3fb707773b17dc1e71d79f1bbf3e0589dfb98c"} Jun 09 15:05:21.812934 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:21.812618 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68bcdcf89b-x924p" podStartSLOduration=1.5512236590000001 podStartE2EDuration="3.812596483s" totalImagesPullingTime="2.261372824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:21.811201222 +0000 UTC m=+268.441404464" watchObservedRunningTime="2026-06-09 15:05:21.812596483 +0000 UTC m=+268.442799723" Jun 09 15:05:24.807294 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:24.807256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"ed5145c4bbd73bf75b0e81968368d63a4eebdb40a851f48a8b07d236a547819b"} Jun 09 15:05:24.807672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:24.807347 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"613fc5546227f9f6c4be07861a997aaf50ac359fd838ed0e28ae2fc643055f5d"} Jun 09 15:05:27.821916 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:27.821877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"454e5d6df29a60b9c40eaabcb76ab7613c6c9e91b915569012143ebc21715efb"} Jun 09 15:05:27.822383 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:27.821946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"46f1965a906495ec9ea2c7ecb7c1bad23fc339c570a3e9c5b04167fe8b4864c4"} Jun 09 15:05:27.822383 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:27.821973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"42c246cae2458527ebc9eb6dda37ecc0c627cedfc52802eda0c49e1a1a6de3ec"} Jun 09 15:05:27.822383 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:27.821998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerStarted","Data":"c6809df79edc3e0035a01aad7de8640604dc380ffbeb000df31d87bacbd62ad5"} Jun 09 15:05:27.853793 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:27.853732 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.898370676 podStartE2EDuration="8.853706693s" totalImagesPullingTime="5.930425384s" totalInitContainerRuntime="24.910633ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:27.851341946 +0000 UTC m=+274.481545186" watchObservedRunningTime="2026-06-09 15:05:27.853706693 +0000 UTC m=+274.483909936" Jun 09 15:05:30.034053 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:30.034019 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:05:35.408865 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:35.408798 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xmlqd" podUID="cf692b1c-dee2-46b4-9d86-706ec5bc51db" Jun 09 15:05:35.408865 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:05:35.408798 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" Jun 09 15:05:35.854333 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:35.854303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:35.854524 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:35.854303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:05:39.245606 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.245571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:39.245606 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.245621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:05:39.248032 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.247994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf692b1c-dee2-46b4-9d86-706ec5bc51db-metrics-tls\") pod \"dns-default-xmlqd\" (UID: \"cf692b1c-dee2-46b4-9d86-706ec5bc51db\") " pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:39.248157 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.248075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"image-registry-5d76d44fc-jcq98\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:05:39.458486 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.458453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zkrcb\"" Jun 09 15:05:39.458486 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.458453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2x6bf\"" Jun 09 15:05:39.465883 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.465848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:39.466030 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.465942 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:05:39.636987 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.636958 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmlqd"] Jun 09 15:05:39.639615 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:39.639585 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf692b1c_dee2_46b4_9d86_706ec5bc51db.slice/crio-545eed59ba0e49a618be442cf65433f542cce6e3c7f835bccde2f798cdaebbf0 WatchSource:0}: Error finding container 545eed59ba0e49a618be442cf65433f542cce6e3c7f835bccde2f798cdaebbf0: Status 404 returned error can't find the container with id 545eed59ba0e49a618be442cf65433f542cce6e3c7f835bccde2f798cdaebbf0 Jun 09 15:05:39.659321 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.659295 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:05:39.661876 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:05:39.661845 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8ccc71_9900_434f_9762_83b6e04a3214.slice/crio-9cf69dfd259a91db072296ef91292cadf6d188353397aedcad6d1b7314719169 WatchSource:0}: Error finding container 9cf69dfd259a91db072296ef91292cadf6d188353397aedcad6d1b7314719169: Status 404 returned error can't find the container with id 9cf69dfd259a91db072296ef91292cadf6d188353397aedcad6d1b7314719169 Jun 09 15:05:39.873005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.872973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" event={"ID":"be8ccc71-9900-434f-9762-83b6e04a3214","Type":"ContainerStarted","Data":"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416"} Jun 09 15:05:39.873217 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.873019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" event={"ID":"be8ccc71-9900-434f-9762-83b6e04a3214","Type":"ContainerStarted","Data":"9cf69dfd259a91db072296ef91292cadf6d188353397aedcad6d1b7314719169"} Jun 09 15:05:39.873217 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.873090 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:05:39.874258 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.874223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmlqd" event={"ID":"cf692b1c-dee2-46b4-9d86-706ec5bc51db","Type":"ContainerStarted","Data":"545eed59ba0e49a618be442cf65433f542cce6e3c7f835bccde2f798cdaebbf0"} Jun 09 15:05:39.894982 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:39.894922 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" podStartSLOduration=285.894904004 podStartE2EDuration="4m45.894904004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:39.893849722 +0000 UTC m=+286.524052963" watchObservedRunningTime="2026-06-09 15:05:39.894904004 +0000 UTC m=+286.525107275" Jun 09 15:05:40.879529 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:40.879497 2563 generic.go:356] "Generic (PLEG): container finished" podID="44791603-2b8f-4b33-bc0b-c920bc34cb1f" containerID="fd3eee88e10ec34929dae18d275c124d197480da8b2d6da3f7c09fad4bf52fd7" exitCode=0 Jun 09 15:05:40.879903 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:40.879569 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ftck8" event={"ID":"44791603-2b8f-4b33-bc0b-c920bc34cb1f","Type":"ContainerDied","Data":"fd3eee88e10ec34929dae18d275c124d197480da8b2d6da3f7c09fad4bf52fd7"} Jun 09 15:05:40.879987 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:40.879973 2563 scope.go:117] "RemoveContainer" containerID="fd3eee88e10ec34929dae18d275c124d197480da8b2d6da3f7c09fad4bf52fd7" Jun 09 15:05:41.885468 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:41.885436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-ftck8" event={"ID":"44791603-2b8f-4b33-bc0b-c920bc34cb1f","Type":"ContainerStarted","Data":"e8c8c135327b953fcb64bd2bce1ffe0b55601b6f33413b030d0650f382459dd0"} Jun 09 15:05:41.886923 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:41.886897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmlqd" event={"ID":"cf692b1c-dee2-46b4-9d86-706ec5bc51db","Type":"ContainerStarted","Data":"cf672a057b8c7674fb001b6e59cf89b3c07046daf62c8622f0b7e218133573f1"} Jun 09 15:05:42.892028 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:42.891989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmlqd" event={"ID":"cf692b1c-dee2-46b4-9d86-706ec5bc51db","Type":"ContainerStarted","Data":"5dbf825aaa296fea5363c05847b40ffbfed7b053b3c2417ac999167ced5da7e4"} Jun 09 15:05:42.892559 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:42.892104 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:42.908805 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:42.908709 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xmlqd" podStartSLOduration=251.826052006 podStartE2EDuration="4m13.908681473s" totalImagesPullingTime="2.082629467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:42.908577293 +0000 UTC m=+289.538780546" watchObservedRunningTime="2026-06-09 15:05:42.908681473 +0000 UTC m=+289.538884720" Jun 09 15:05:43.655766 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:43.655734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/init-config-reloader/0.log" Jun 09 15:05:43.855685 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:43.855663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/alertmanager/0.log" Jun 09 15:05:44.055888 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:44.055806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/config-reloader/0.log" Jun 09 15:05:44.256153 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:44.256122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/kube-rbac-proxy-web/0.log" Jun 09 15:05:44.456019 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:44.455986 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/kube-rbac-proxy/0.log" Jun 09 15:05:44.656375 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:44.656348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/kube-rbac-proxy-metric/0.log" Jun 09 15:05:44.855429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:44.855401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98431df6-48be-44bf-994f-352b7a78c01c/prom-label-proxy/0.log" Jun 09 15:05:45.057116 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:45.057087 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:45.278132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:45.278033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:45.457083 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:45.457057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/1.log" Jun 09 15:05:45.656489 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:45.656461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-state-metrics/0.log" Jun 09 15:05:45.856106 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:45.856079 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-rbac-proxy-main/0.log" Jun 09 15:05:46.055372 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:46.055300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-rbac-proxy-self/0.log" Jun 09 15:05:47.855904 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:47.855863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/init-textfile/0.log" Jun 09 15:05:48.056247 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:48.056218 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/node-exporter/0.log" Jun 09 15:05:48.256077 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:48.256001 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/kube-rbac-proxy/0.log" Jun 09 15:05:48.455798 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:48.455768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/kube-rbac-proxy-main/0.log" Jun 09 15:05:48.655830 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:48.655806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/kube-rbac-proxy-self/0.log" Jun 09 15:05:48.855801 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:48.855776 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/openshift-state-metrics/0.log" Jun 09 15:05:49.055844 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:49.055765 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/init-config-reloader/0.log" Jun 09 15:05:49.256492 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:49.256464 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/prometheus/0.log" Jun 09 15:05:49.455702 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:49.455678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/config-reloader/0.log" Jun 09 15:05:49.656277 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:49.656253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/thanos-sidecar/0.log" Jun 09 15:05:49.855295 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:49.855259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/kube-rbac-proxy-web/0.log" Jun 09 15:05:50.057667 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:50.057641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/kube-rbac-proxy/0.log" Jun 09 15:05:50.255816 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:50.255741 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0f328ab-e9ea-4074-8c14-41d747022909/kube-rbac-proxy-thanos/0.log" Jun 09 15:05:50.855325 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:50.855297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-stffx_1797c1ba-16f5-403c-b197-33ca2ae47069/prometheus-operator-admission-webhook/0.log" Jun 09 15:05:51.058149 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:51.058116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/telemeter-client/0.log" Jun 09 15:05:51.256637 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:51.256566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/reload/0.log" Jun 09 15:05:51.458039 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:51.458013 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/kube-rbac-proxy/0.log" Jun 09 15:05:52.898511 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:52.898481 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xmlqd" Jun 09 15:05:53.794490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:53.794459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:53.795347 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:53.795322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:05:53.808680 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:53.808654 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:05:54.855803 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:54.855771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmlqd_cf692b1c-dee2-46b4-9d86-706ec5bc51db/dns/0.log" Jun 09 15:05:55.056442 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:55.056417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmlqd_cf692b1c-dee2-46b4-9d86-706ec5bc51db/kube-rbac-proxy/0.log" Jun 09 15:05:55.655396 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:55.655371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrdfn_8ee049a3-ac31-42dd-aec3-ae7044f01c66/dns-node-resolver/0.log" Jun 09 15:05:55.856481 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:55.856454 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d76d44fc-jcq98_be8ccc71-9900-434f-9762-83b6e04a3214/registry/0.log" Jun 09 15:05:56.456380 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:56.456351 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4lzw_dd337ebb-9c52-4890-adb4-0645c3b2b784/node-ca/0.log" Jun 09 15:05:57.256069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:57.256041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cf2d_48761377-1856-4b2d-875c-c9e706bd9f8f/serve-healthcheck-canary/0.log" Jun 09 15:05:59.470762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:59.470724 2563 patch_prober.go:28] interesting pod/image-registry-5d76d44fc-jcq98 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:59.471144 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:05:59.470782 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:06:00.885482 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.885413 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:06:00.980460 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.980432 2563 generic.go:356] "Generic (PLEG): container finished" podID="427a5d5c-7dc1-4991-b731-2a70b934aa64" containerID="1133d9f6611e8f6c6562d1cbace55bf9972b249acdcced9525e9d0c58d88c464" exitCode=0 Jun 09 15:06:00.980636 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.980509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" event={"ID":"427a5d5c-7dc1-4991-b731-2a70b934aa64","Type":"ContainerDied","Data":"1133d9f6611e8f6c6562d1cbace55bf9972b249acdcced9525e9d0c58d88c464"} Jun 09 15:06:00.980948 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.980910 2563 scope.go:117] "RemoveContainer" containerID="1133d9f6611e8f6c6562d1cbace55bf9972b249acdcced9525e9d0c58d88c464" Jun 09 15:06:00.982768 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.982744 2563 generic.go:356] "Generic (PLEG): container finished" podID="3c701304-864c-4349-8824-82ca3f05c5aa" containerID="74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275" exitCode=255 Jun 09 15:06:00.982848 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.982791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerDied","Data":"74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275"} Jun 09 15:06:00.982848 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.982831 2563 scope.go:117] "RemoveContainer" containerID="58359511ee35164cccc040c09b2c909cb8b1846f4f494681dd4ae6f07d92e081" Jun 09 15:06:00.990931 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:00.990909 2563 scope.go:117] "RemoveContainer" containerID="74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275" Jun 09 15:06:00.991139 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:00.991111 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg_open-cluster-management-agent-addon(3c701304-864c-4349-8824-82ca3f05c5aa)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" podUID="3c701304-864c-4349-8824-82ca3f05c5aa" Jun 09 15:06:01.993392 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:01.993344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-q8jnf" event={"ID":"427a5d5c-7dc1-4991-b731-2a70b934aa64","Type":"ContainerStarted","Data":"922a3e89b5585610c701c5d188c39d936b78e0847512756df1a79ef50a070fe4"} Jun 09 15:06:06.851642 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:06.851606 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" Jun 09 15:06:06.852024 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:06.851973 2563 scope.go:117] "RemoveContainer" containerID="74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275" Jun 09 15:06:06.852154 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:06.852135 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg_open-cluster-management-agent-addon(3c701304-864c-4349-8824-82ca3f05c5aa)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" podUID="3c701304-864c-4349-8824-82ca3f05c5aa" Jun 09 15:06:20.034596 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:20.034554 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:20.055372 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:20.055339 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:20.086498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:20.086472 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:20.837140 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:20.837109 2563 scope.go:117] "RemoveContainer" containerID="74014a0689919a157f27d9966bba3d036737f8ae4043b308b9f99e006182a275" Jun 09 15:06:21.079644 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:21.079596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6db5ffb7b6-dwbcg" event={"ID":"3c701304-864c-4349-8824-82ca3f05c5aa","Type":"ContainerStarted","Data":"d1303903af3d067233ccbff1d37034f3f8f5de3e4426488d81a69abf4086d495"} Jun 09 15:06:24.618376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:24.618340 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:06:33.705529 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705490 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:33.705985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705808 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="alertmanager" containerID="cri-o://8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e" gracePeriod=120 Jun 09 15:06:33.705985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705837 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy" containerID="cri-o://ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da" gracePeriod=120 Jun 09 15:06:33.705985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705875 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="prom-label-proxy" containerID="cri-o://cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a" gracePeriod=120 Jun 09 15:06:33.705985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705886 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-metric" containerID="cri-o://2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e" gracePeriod=120 Jun 09 15:06:33.705985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705918 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="config-reloader" containerID="cri-o://4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980" gracePeriod=120 Jun 09 15:06:33.706230 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:33.705897 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-web" containerID="cri-o://8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858" gracePeriod=120 Jun 09 15:06:34.136307 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136271 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a" exitCode=0 Jun 09 15:06:34.136307 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136300 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da" exitCode=0 Jun 09 15:06:34.136307 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136309 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858" exitCode=0 Jun 09 15:06:34.136307 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136316 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980" exitCode=0 Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136323 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e" exitCode=0 Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a"} Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136409 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da"} Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858"} Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980"} Jun 09 15:06:34.136577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.136496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e"} Jun 09 15:06:34.947671 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.947642 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:34.965222 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965178 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965242 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965282 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965366 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965405 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965452 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965483 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snkjt\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965527 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965556 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965585 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965618 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.965672 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965648 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume\") pod \"98431df6-48be-44bf-994f-352b7a78c01c\" (UID: \"98431df6-48be-44bf-994f-352b7a78c01c\") " Jun 09 15:06:34.966069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.965811 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:34.966069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.966047 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:34.966563 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.966534 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:34.966868 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.966841 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:06:34.968447 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.968381 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:34.968815 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.968782 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.969011 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.968962 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.969011 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.968983 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.969192 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.969063 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out" (OuterVolumeSpecName: "config-out") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:06:34.970012 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.969988 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt" (OuterVolumeSpecName: "kube-api-access-snkjt") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "kube-api-access-snkjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:34.970012 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.969996 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.970620 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.970592 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume" (OuterVolumeSpecName: "config-volume") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.973088 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.973062 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:34.983080 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:34.983039 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config" (OuterVolumeSpecName: "web-config") pod "98431df6-48be-44bf-994f-352b7a78c01c" (UID: "98431df6-48be-44bf-994f-352b7a78c01c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067154 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-tls-assets\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067201 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-main-tls\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067212 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98431df6-48be-44bf-994f-352b7a78c01c-metrics-client-ca\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067220 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snkjt\" (UniqueName: \"kubernetes.io/projected/98431df6-48be-44bf-994f-352b7a78c01c-kube-api-access-snkjt\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067229 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-alertmanager-main-db\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067240 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067250 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-cluster-tls-config\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067258 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98431df6-48be-44bf-994f-352b7a78c01c-config-out\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067260 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067267 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-config-volume\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067645 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067277 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-web-config\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067645 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067285 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.067645 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.067294 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98431df6-48be-44bf-994f-352b7a78c01c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:35.143602 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.143570 2563 generic.go:356] "Generic (PLEG): container finished" podID="98431df6-48be-44bf-994f-352b7a78c01c" containerID="2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e" exitCode=0 Jun 09 15:06:35.143802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.143618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e"} Jun 09 15:06:35.143802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.143641 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.143802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.143694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98431df6-48be-44bf-994f-352b7a78c01c","Type":"ContainerDied","Data":"6969d2c73d640cfc5e0b7b083a250b4b906878d31c69ba6f830a5e8170cbba90"} Jun 09 15:06:35.143802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.143739 2563 scope.go:117] "RemoveContainer" containerID="cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a" Jun 09 15:06:35.152659 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.152641 2563 scope.go:117] "RemoveContainer" containerID="2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e" Jun 09 15:06:35.160237 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.160217 2563 scope.go:117] "RemoveContainer" containerID="ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da" Jun 09 15:06:35.167947 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.167914 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:35.169365 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.169346 2563 scope.go:117] "RemoveContainer" containerID="8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858" Jun 09 15:06:35.171206 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.171154 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:35.177271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.177248 2563 scope.go:117] "RemoveContainer" containerID="4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980" Jun 09 15:06:35.184828 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.184810 2563 scope.go:117] "RemoveContainer" containerID="8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e" Jun 09 15:06:35.192964 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.192934 2563 scope.go:117] "RemoveContainer" containerID="7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25" Jun 09 15:06:35.198371 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.198332 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:35.199175 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199144 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-metric" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199183 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-metric" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199215 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="alertmanager" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199224 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="alertmanager" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199241 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="prom-label-proxy" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199250 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="prom-label-proxy" Jun 09 15:06:35.199279 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199280 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="config-reloader" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199288 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="config-reloader" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199305 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="init-config-reloader" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199321 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="init-config-reloader" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199364 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-web" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199379 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-web" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199392 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy" Jun 09 15:06:35.199541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199400 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199547 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="prom-label-proxy" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199568 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="config-reloader" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199583 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-web" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199592 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="alertmanager" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199606 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy" Jun 09 15:06:35.199833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.199614 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98431df6-48be-44bf-994f-352b7a78c01c" containerName="kube-rbac-proxy-metric" Jun 09 15:06:35.205807 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.205779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.207476 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.207449 2563 scope.go:117] "RemoveContainer" containerID="cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a" Jun 09 15:06:35.207801 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.207780 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a\": container with ID starting with cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a not found: ID does not exist" containerID="cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a" Jun 09 15:06:35.207849 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.207809 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a"} err="failed to get container status \"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a\": rpc error: code = NotFound desc = could not find container \"cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a\": container with ID starting with cc46b1c7165c07605385ff1ecd4400c8b553d573b8e9cb3c1a33b2aab9f8650a not found: ID does not exist" Jun 09 15:06:35.207849 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.207839 2563 scope.go:117] "RemoveContainer" containerID="2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e" Jun 09 15:06:35.208107 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.208086 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e\": container with ID starting with 2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e not found: ID does not exist" containerID="2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e" Jun 09 15:06:35.208195 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208117 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e"} err="failed to get container status \"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e\": rpc error: code = NotFound desc = could not find container \"2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e\": container with ID starting with 2e719c0af90d9b1e0bfdc4df30e10c1603226a758d6dbad9ad12b7f319cd9e1e not found: ID does not exist" Jun 09 15:06:35.208195 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208141 2563 scope.go:117] "RemoveContainer" containerID="ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da" Jun 09 15:06:35.208480 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.208455 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da\": container with ID starting with ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da not found: ID does not exist" containerID="ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da" Jun 09 15:06:35.208583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208483 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da"} err="failed to get container status \"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da\": rpc error: code = NotFound desc = could not find container \"ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da\": container with ID starting with ab764ce580f02253dc520ff7d5cb04cf3f9bb52902f94ced7ea52ccdf72eb5da not found: ID does not exist" Jun 09 15:06:35.208583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 15:06:35.208583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208497 2563 scope.go:117] "RemoveContainer" containerID="8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858" Jun 09 15:06:35.208583 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208542 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 15:06:35.208786 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208603 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ns2hc\"" Jun 09 15:06:35.208786 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208632 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 15:06:35.208786 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208769 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 15:06:35.208932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 15:06:35.208932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 15:06:35.208932 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.208845 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858\": container with ID starting with 8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858 not found: ID does not exist" containerID="8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858" Jun 09 15:06:35.208932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208871 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858"} err="failed to get container status \"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858\": rpc error: code = NotFound desc = could not find container \"8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858\": container with ID starting with 8749010cc45b922319cf85e41f8acc0a9c7500e902515ebab265761fcc010858 not found: ID does not exist" Jun 09 15:06:35.208932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.208899 2563 scope.go:117] "RemoveContainer" containerID="4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980" Jun 09 15:06:35.209154 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 15:06:35.209154 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 15:06:35.209294 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.209202 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980\": container with ID starting with 4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980 not found: ID does not exist" containerID="4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980" Jun 09 15:06:35.209294 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209228 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980"} err="failed to get container status \"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980\": rpc error: code = NotFound desc = could not find container \"4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980\": container with ID starting with 4137450569a037112b6bd148faa4282961f095cc2d2dcfb795a80a4be89f7980 not found: ID does not exist" Jun 09 15:06:35.209294 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209248 2563 scope.go:117] "RemoveContainer" containerID="8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e" Jun 09 15:06:35.209536 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.209516 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e\": container with ID starting with 8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e not found: ID does not exist" containerID="8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e" Jun 09 15:06:35.209536 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209538 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e"} err="failed to get container status \"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e\": rpc error: code = NotFound desc = could not find container \"8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e\": container with ID starting with 8a7f05dfde38e872ec411b7c8fca325f8b8c14a29f73f6fa6699308de688ca4e not found: ID does not exist" Jun 09 15:06:35.209668 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209552 2563 scope.go:117] "RemoveContainer" containerID="7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25" Jun 09 15:06:35.209825 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:35.209807 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25\": container with ID starting with 7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25 not found: ID does not exist" containerID="7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25" Jun 09 15:06:35.209892 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.209831 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25"} err="failed to get container status \"7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25\": rpc error: code = NotFound desc = could not find container \"7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25\": container with ID starting with 7455d915d5078486915c0fc6c02dfe4d7e098b3ed188add18cd0019dff9d6e25 not found: ID does not exist" Jun 09 15:06:35.213810 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.213791 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 15:06:35.219530 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.219503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:35.268179 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk8wd\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-kube-api-access-xk8wd\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268655 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.268655 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.268562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369145 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8wd\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-kube-api-access-xk8wd\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369145 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369397 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369397 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369397 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369397 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369397 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369657 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369888 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.369888 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.369682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.370868 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.370838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.371287 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.371234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1523c7-9111-4238-849f-0adf29799405-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.372748 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.372712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.372965 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.372947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1523c7-9111-4238-849f-0adf29799405-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373068 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373209 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373291 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373509 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.373877 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.373853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.374399 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.374383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1523c7-9111-4238-849f-0adf29799405-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.377851 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.377825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk8wd\" (UniqueName: \"kubernetes.io/projected/3a1523c7-9111-4238-849f-0adf29799405-kube-api-access-xk8wd\") pod \"alertmanager-main-0\" (UID: \"3a1523c7-9111-4238-849f-0adf29799405\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.517126 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.517083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:06:35.662295 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.662264 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:06:35.664321 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:06:35.664297 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1523c7_9111_4238_849f_0adf29799405.slice/crio-4cb0e54b1539141e669df3504d1885cc6d2bdcbccbecfc52b158d9a985d701c3 WatchSource:0}: Error finding container 4cb0e54b1539141e669df3504d1885cc6d2bdcbccbecfc52b158d9a985d701c3: Status 404 returned error can't find the container with id 4cb0e54b1539141e669df3504d1885cc6d2bdcbccbecfc52b158d9a985d701c3 Jun 09 15:06:35.842547 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:35.842512 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98431df6-48be-44bf-994f-352b7a78c01c" path="/var/lib/kubelet/pods/98431df6-48be-44bf-994f-352b7a78c01c/volumes" Jun 09 15:06:36.149821 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:36.149783 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a1523c7-9111-4238-849f-0adf29799405" containerID="724e874f5835c873a6746394b9f3ebe631061da003f62d29c8eecf719f3d1fc8" exitCode=0 Jun 09 15:06:36.150343 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:36.149870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerDied","Data":"724e874f5835c873a6746394b9f3ebe631061da003f62d29c8eecf719f3d1fc8"} Jun 09 15:06:36.150343 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:36.149964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"4cb0e54b1539141e669df3504d1885cc6d2bdcbccbecfc52b158d9a985d701c3"} Jun 09 15:06:37.158320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158286 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"887160f3dc4fe889d0b7b74dcd9b98b8a168fb0b09ab4d8205af5d95bec8a65f"} Jun 09 15:06:37.158773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158359 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"2874c829d9662c009cf67504279df122e55bb87d462f9216612be6f1f3bac14b"} Jun 09 15:06:37.158773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158401 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"84fe34060834a7abaa69b948da0d66a5343cf0538d03a33334b66ad26e85651c"} Jun 09 15:06:37.158773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"e194352290a1892ce38fdae60562e5580e20bf14fcf4ed9d72302ce5035e2068"} Jun 09 15:06:37.158773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158490 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"bb2eee6c9723065879422f3ef6a6a6edab47407836ca80065da9fca773d05af3"} Jun 09 15:06:37.158773 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.158526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1523c7-9111-4238-849f-0adf29799405","Type":"ContainerStarted","Data":"443c58b306ee2fddf49a1b4aedbc6298ba0b3b1519ace7a31ef4cb3f1d573805"} Jun 09 15:06:37.186287 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.186218 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.169629369 podStartE2EDuration="2.186187936s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.558567ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:37.184069919 +0000 UTC m=+343.814273178" watchObservedRunningTime="2026-06-09 15:06:37.186187936 +0000 UTC m=+343.816391176" Jun 09 15:06:37.936079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936040 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:37.936370 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936341 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="prometheus" containerID="cri-o://613fc5546227f9f6c4be07861a997aaf50ac359fd838ed0e28ae2fc643055f5d" gracePeriod=600 Jun 09 15:06:37.936467 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936358 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy" containerID="cri-o://46f1965a906495ec9ea2c7ecb7c1bad23fc339c570a3e9c5b04167fe8b4864c4" gracePeriod=600 Jun 09 15:06:37.936467 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936419 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-web" containerID="cri-o://42c246cae2458527ebc9eb6dda37ecc0c627cedfc52802eda0c49e1a1a6de3ec" gracePeriod=600 Jun 09 15:06:37.936467 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936419 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="thanos-sidecar" containerID="cri-o://c6809df79edc3e0035a01aad7de8640604dc380ffbeb000df31d87bacbd62ad5" gracePeriod=600 Jun 09 15:06:37.936628 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936449 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-thanos" containerID="cri-o://454e5d6df29a60b9c40eaabcb76ab7613c6c9e91b915569012143ebc21715efb" gracePeriod=600 Jun 09 15:06:37.936628 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:37.936427 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="config-reloader" containerID="cri-o://ed5145c4bbd73bf75b0e81968368d63a4eebdb40a851f48a8b07d236a547819b" gracePeriod=600 Jun 09 15:06:38.166860 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166828 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="454e5d6df29a60b9c40eaabcb76ab7613c6c9e91b915569012143ebc21715efb" exitCode=0 Jun 09 15:06:38.166860 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166854 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="46f1965a906495ec9ea2c7ecb7c1bad23fc339c570a3e9c5b04167fe8b4864c4" exitCode=0 Jun 09 15:06:38.166860 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166862 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="42c246cae2458527ebc9eb6dda37ecc0c627cedfc52802eda0c49e1a1a6de3ec" exitCode=0 Jun 09 15:06:38.166860 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166870 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="c6809df79edc3e0035a01aad7de8640604dc380ffbeb000df31d87bacbd62ad5" exitCode=0 Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166877 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="ed5145c4bbd73bf75b0e81968368d63a4eebdb40a851f48a8b07d236a547819b" exitCode=0 Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166885 2563 generic.go:356] "Generic (PLEG): container finished" podID="e0f328ab-e9ea-4074-8c14-41d747022909" containerID="613fc5546227f9f6c4be07861a997aaf50ac359fd838ed0e28ae2fc643055f5d" exitCode=0 Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"454e5d6df29a60b9c40eaabcb76ab7613c6c9e91b915569012143ebc21715efb"} Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.166989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"46f1965a906495ec9ea2c7ecb7c1bad23fc339c570a3e9c5b04167fe8b4864c4"} Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.167022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"42c246cae2458527ebc9eb6dda37ecc0c627cedfc52802eda0c49e1a1a6de3ec"} Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.167049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"c6809df79edc3e0035a01aad7de8640604dc380ffbeb000df31d87bacbd62ad5"} Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.167073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"ed5145c4bbd73bf75b0e81968368d63a4eebdb40a851f48a8b07d236a547819b"} Jun 09 15:06:38.167484 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.167097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"613fc5546227f9f6c4be07861a997aaf50ac359fd838ed0e28ae2fc643055f5d"} Jun 09 15:06:38.175958 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.175928 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:38.299351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299253 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299294 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299315 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299351 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299346 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299366 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299390 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299409 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299427 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299455 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299492 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299523 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299554 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299583 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8dvk\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299611 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299642 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.299674 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299674 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299716 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299757 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299797 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299827 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299864 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2\") pod \"e0f328ab-e9ea-4074-8c14-41d747022909\" (UID: \"e0f328ab-e9ea-4074-8c14-41d747022909\") " Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.299973 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.300193 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-metrics-client-ca\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.300311 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.300215 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.300716 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.300321 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.300716 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.300498 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.302285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302073 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.302285 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302125 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.302542 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302507 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.302542 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302526 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.302737 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302554 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:38.302998 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302854 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.302998 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302883 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out" (OuterVolumeSpecName: "config-out") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:06:38.302998 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302939 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.302998 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.302949 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.304070 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.304029 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:06:38.304317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.304291 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:38.304755 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.304729 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.304833 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.304763 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config" (OuterVolumeSpecName: "config") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.305108 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.305088 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk" (OuterVolumeSpecName: "kube-api-access-f8dvk") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "kube-api-access-f8dvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:38.305217 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.305199 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.314251 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.314220 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config" (OuterVolumeSpecName: "web-config") pod "e0f328ab-e9ea-4074-8c14-41d747022909" (UID: "e0f328ab-e9ea-4074-8c14-41d747022909"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:38.401426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401387 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-metrics-client-certs\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401417 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401426 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401435 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401444 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-kube-rbac-proxy\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401452 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401462 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401471 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401481 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401489 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-web-config\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401498 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-tls-assets\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401508 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f328ab-e9ea-4074-8c14-41d747022909-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401517 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401526 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-config-out\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401535 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-config\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401543 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0f328ab-e9ea-4074-8c14-41d747022909-secret-grpc-tls\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401550 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8dvk\" (UniqueName: \"kubernetes.io/projected/e0f328ab-e9ea-4074-8c14-41d747022909-kube-api-access-f8dvk\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:38.401670 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:38.401558 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0f328ab-e9ea-4074-8c14-41d747022909-prometheus-k8s-db\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:39.175228 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.175188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0f328ab-e9ea-4074-8c14-41d747022909","Type":"ContainerDied","Data":"15660637e5f44c9c124ddbcf0d4e1ee605d12d57e0fc61b3934fe25119cc5f60"} Jun 09 15:06:39.175625 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.175259 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.175625 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.175286 2563 scope.go:117] "RemoveContainer" containerID="454e5d6df29a60b9c40eaabcb76ab7613c6c9e91b915569012143ebc21715efb" Jun 09 15:06:39.183541 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.183519 2563 scope.go:117] "RemoveContainer" containerID="46f1965a906495ec9ea2c7ecb7c1bad23fc339c570a3e9c5b04167fe8b4864c4" Jun 09 15:06:39.191667 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.191644 2563 scope.go:117] "RemoveContainer" containerID="42c246cae2458527ebc9eb6dda37ecc0c627cedfc52802eda0c49e1a1a6de3ec" Jun 09 15:06:39.200183 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.200143 2563 scope.go:117] "RemoveContainer" containerID="c6809df79edc3e0035a01aad7de8640604dc380ffbeb000df31d87bacbd62ad5" Jun 09 15:06:39.200831 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.200803 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:39.207858 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.207828 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:39.208717 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.208695 2563 scope.go:117] "RemoveContainer" containerID="ed5145c4bbd73bf75b0e81968368d63a4eebdb40a851f48a8b07d236a547819b" Jun 09 15:06:39.216487 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.216466 2563 scope.go:117] "RemoveContainer" containerID="613fc5546227f9f6c4be07861a997aaf50ac359fd838ed0e28ae2fc643055f5d" Jun 09 15:06:39.224861 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.224837 2563 scope.go:117] "RemoveContainer" containerID="1d5340160f96434da8154e83a8f56fe3b291cf9df86fc33b3ae239b929e80eb4" Jun 09 15:06:39.234517 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234490 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:39.234844 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234829 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="config-reloader" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234846 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="config-reloader" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234859 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-thanos" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234867 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-thanos" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234880 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-web" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234891 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-web" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234906 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="init-config-reloader" Jun 09 15:06:39.234915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234914 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="init-config-reloader" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234929 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="prometheus" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234938 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="prometheus" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234946 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234955 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234970 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="thanos-sidecar" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.234978 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="thanos-sidecar" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235055 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="prometheus" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235067 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="thanos-sidecar" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235077 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-web" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235086 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235097 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="kube-rbac-proxy-thanos" Jun 09 15:06:39.235320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.235106 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" containerName="config-reloader" Jun 09 15:06:39.238546 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.238525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.241284 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241254 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 15:06:39.241385 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241308 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 15:06:39.241442 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tmcqc\"" Jun 09 15:06:39.241442 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 15:06:39.241544 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241504 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 15:06:39.241719 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 15:06:39.241802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241750 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 15:06:39.241802 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241757 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:06:39.241906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 15:06:39.241906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 15:06:39.241906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241874 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2jsgqc1kqvgrg\"" Jun 09 15:06:39.241906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241859 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 15:06:39.241906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.241903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 15:06:39.242334 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.242319 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 15:06:39.242407 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.242390 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 15:06:39.244436 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.244416 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 15:06:39.248135 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.248114 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 15:06:39.258829 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.258799 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:39.309800 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.309800 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7vf\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-kube-api-access-mn7vf\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-config-out\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.309990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-web-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310499 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.310499 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.310355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411327 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411327 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-web-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7vf\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-kube-api-access-mn7vf\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-config-out\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.411870 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.411835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.412557 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.412527 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.413367 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.413337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-web-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-config\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.414587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.415030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415281 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.415153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.415398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.415405 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.415762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.415539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.416631 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.416604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.416900 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.416878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.417429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.417402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27708be4-5f5c-4969-b132-614e414e088d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.417642 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.417624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.417707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.417662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27708be4-5f5c-4969-b132-614e414e088d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.417945 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.417926 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27708be4-5f5c-4969-b132-614e414e088d-config-out\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.421789 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.421765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7vf\" (UniqueName: \"kubernetes.io/projected/27708be4-5f5c-4969-b132-614e414e088d-kube-api-access-mn7vf\") pod \"prometheus-k8s-0\" (UID: \"27708be4-5f5c-4969-b132-614e414e088d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.549425 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.549323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:39.697826 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.697789 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 15:06:39.701783 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:06:39.701752 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27708be4_5f5c_4969_b132_614e414e088d.slice/crio-22b0eacead40ac89bdd63c160c9d6924d3a37f2336d7c89c1b67494c4f57516b WatchSource:0}: Error finding container 22b0eacead40ac89bdd63c160c9d6924d3a37f2336d7c89c1b67494c4f57516b: Status 404 returned error can't find the container with id 22b0eacead40ac89bdd63c160c9d6924d3a37f2336d7c89c1b67494c4f57516b Jun 09 15:06:39.842517 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:39.842489 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f328ab-e9ea-4074-8c14-41d747022909" path="/var/lib/kubelet/pods/e0f328ab-e9ea-4074-8c14-41d747022909/volumes" Jun 09 15:06:40.182031 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:40.181932 2563 generic.go:356] "Generic (PLEG): container finished" podID="27708be4-5f5c-4969-b132-614e414e088d" containerID="9c60d9f58482c4048cc2b1b11aae59545645abac666d8ddd162f2513d71b0adc" exitCode=0 Jun 09 15:06:40.182031 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:40.182008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerDied","Data":"9c60d9f58482c4048cc2b1b11aae59545645abac666d8ddd162f2513d71b0adc"} Jun 09 15:06:40.182495 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:40.182085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"22b0eacead40ac89bdd63c160c9d6924d3a37f2336d7c89c1b67494c4f57516b"} Jun 09 15:06:41.189242 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189207 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"3f8c4a9f58d33a534a746c8c8f654981909d85b585c555c14c785bb1dc9a0426"} Jun 09 15:06:41.189746 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"eaf4437777f52d99c63e1f22d397404a270f7e481ba31fb124a3b0c3337f571f"} Jun 09 15:06:41.189746 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"005f7e63c58d09c5c873a44e18df30b76aba6da130b358730dbcb8cb5d1c7a11"} Jun 09 15:06:41.189746 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"dbba2c489c3ee2f2346332e8c6f33a7601df8dee1bb662f6c8eed37981ba1e2c"} Jun 09 15:06:41.189746 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"de1a68d7b83f15386fb85640ea80979245dcc71f52075fd4b0b8092045135c3f"} Jun 09 15:06:41.189746 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.189454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27708be4-5f5c-4969-b132-614e414e088d","Type":"ContainerStarted","Data":"2f618ee77430129b7cab2426965666c8185807c6be81f5e019507dd9ad7b15cd"} Jun 09 15:06:41.222823 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:41.222766 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.2024386639999998 podStartE2EDuration="2.222745242s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.306578ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:41.220351675 +0000 UTC m=+347.850554940" watchObservedRunningTime="2026-06-09 15:06:41.222745242 +0000 UTC m=+347.852948481" Jun 09 15:06:44.549981 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:44.549876 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:06:49.641842 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:49.641779 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" containerName="registry" containerID="cri-o://d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416" gracePeriod=30 Jun 09 15:06:49.902643 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:49.902580 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:06:50.010018 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.009975 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010035 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqpsv\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010062 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010090 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010114 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010141 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010221 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010571 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010254 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration\") pod \"be8ccc71-9900-434f-9762-83b6e04a3214\" (UID: \"be8ccc71-9900-434f-9762-83b6e04a3214\") " Jun 09 15:06:50.010654 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010626 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:50.011029 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.010999 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:06:50.013123 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.013084 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:50.013123 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.013092 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:50.013306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.013226 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv" (OuterVolumeSpecName: "kube-api-access-lqpsv") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "kube-api-access-lqpsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:50.013306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.013253 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:06:50.013306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.013252 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:06:50.018915 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.018882 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "be8ccc71-9900-434f-9762-83b6e04a3214" (UID: "be8ccc71-9900-434f-9762-83b6e04a3214"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:06:50.111874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111829 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-registry-tls\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.111874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111864 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqpsv\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-kube-api-access-lqpsv\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.111874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111876 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-registry-certificates\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.111874 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111884 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8ccc71-9900-434f-9762-83b6e04a3214-bound-sa-token\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.112128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111892 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be8ccc71-9900-434f-9762-83b6e04a3214-ca-trust-extracted\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.112128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111900 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccc71-9900-434f-9762-83b6e04a3214-trusted-ca\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.112128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111909 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-installation-pull-secrets\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.112128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.111918 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be8ccc71-9900-434f-9762-83b6e04a3214-image-registry-private-configuration\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:06:50.228739 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.228638 2563 generic.go:356] "Generic (PLEG): container finished" podID="be8ccc71-9900-434f-9762-83b6e04a3214" containerID="d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416" exitCode=0 Jun 09 15:06:50.228739 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.228685 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" Jun 09 15:06:50.228972 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.228736 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" event={"ID":"be8ccc71-9900-434f-9762-83b6e04a3214","Type":"ContainerDied","Data":"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416"} Jun 09 15:06:50.228972 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.228805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d76d44fc-jcq98" event={"ID":"be8ccc71-9900-434f-9762-83b6e04a3214","Type":"ContainerDied","Data":"9cf69dfd259a91db072296ef91292cadf6d188353397aedcad6d1b7314719169"} Jun 09 15:06:50.228972 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.228838 2563 scope.go:117] "RemoveContainer" containerID="d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416" Jun 09 15:06:50.238240 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.238219 2563 scope.go:117] "RemoveContainer" containerID="d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416" Jun 09 15:06:50.238547 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:06:50.238525 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416\": container with ID starting with d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416 not found: ID does not exist" containerID="d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416" Jun 09 15:06:50.238622 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.238560 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416"} err="failed to get container status \"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416\": rpc error: code = NotFound desc = could not find container \"d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416\": container with ID starting with d35e4e652378daa57ad36330e315421b2cad9210b50879a3ce8bacff7f780416 not found: ID does not exist" Jun 09 15:06:50.250479 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.250441 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:06:50.256770 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:50.256736 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d76d44fc-jcq98"] Jun 09 15:06:51.842418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:06:51.842380 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" path="/var/lib/kubelet/pods/be8ccc71-9900-434f-9762-83b6e04a3214/volumes" Jun 09 15:07:39.550340 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:07:39.550293 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:07:39.566284 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:07:39.566257 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:07:40.451322 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:07:40.451294 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 15:08:19.342712 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.342635 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq"] Jun 09 15:08:19.343185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.342979 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" containerName="registry" Jun 09 15:08:19.343185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.342989 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" containerName="registry" Jun 09 15:08:19.343185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.343041 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8ccc71-9900-434f-9762-83b6e04a3214" containerName="registry" Jun 09 15:08:19.345840 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.345824 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.348301 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.348275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:08:19.349378 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.349357 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:08:19.349510 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.349449 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r4hw2\"" Jun 09 15:08:19.354804 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.354781 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq"] Jun 09 15:08:19.391861 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.391814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45s7j\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-kube-api-access-45s7j\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.392029 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.391880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.493400 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.493357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.493586 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.493440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45s7j\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-kube-api-access-45s7j\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.501153 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.501124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.501299 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.501229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45s7j\" (UniqueName: \"kubernetes.io/projected/6f1453ee-0413-4626-9073-56f1c59ea8dc-kube-api-access-45s7j\") pod \"cert-manager-webhook-7dc76cbb94-c2wzq\" (UID: \"6f1453ee-0413-4626-9073-56f1c59ea8dc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.655074 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.654982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:19.789663 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.789534 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq"] Jun 09 15:08:19.792175 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:08:19.792128 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f1453ee_0413_4626_9073_56f1c59ea8dc.slice/crio-d71b7984096b53d62230ad9f96656a818bffc12b581c9392ac6273f1e1b80645 WatchSource:0}: Error finding container d71b7984096b53d62230ad9f96656a818bffc12b581c9392ac6273f1e1b80645: Status 404 returned error can't find the container with id d71b7984096b53d62230ad9f96656a818bffc12b581c9392ac6273f1e1b80645 Jun 09 15:08:19.794256 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:19.794237 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:08:20.610851 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:20.610807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" event={"ID":"6f1453ee-0413-4626-9073-56f1c59ea8dc","Type":"ContainerStarted","Data":"d71b7984096b53d62230ad9f96656a818bffc12b581c9392ac6273f1e1b80645"} Jun 09 15:08:22.621777 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:22.621695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" event={"ID":"6f1453ee-0413-4626-9073-56f1c59ea8dc","Type":"ContainerStarted","Data":"1e86354375827aa05535be8846f6a6851a829958e85b4d6ba35dbb1c0e101ca1"} Jun 09 15:08:22.622134 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:22.621813 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:22.642608 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:22.642553 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" podStartSLOduration=1.085129515 podStartE2EDuration="3.642535004s" totalImagesPullingTime="2.557405489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:22.64188567 +0000 UTC m=+449.272088911" watchObservedRunningTime="2026-06-09 15:08:22.642535004 +0000 UTC m=+449.272738244" Jun 09 15:08:28.628062 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:28.628027 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-c2wzq" Jun 09 15:08:38.140359 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.140320 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5qnlz"] Jun 09 15:08:38.143645 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.143622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.146184 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.146147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c7988\"" Jun 09 15:08:38.153255 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.153231 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5qnlz"] Jun 09 15:08:38.267757 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.267715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-bound-sa-token\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.267960 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.267862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98qb\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-kube-api-access-x98qb\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.368597 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.368545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98qb\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-kube-api-access-x98qb\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.368597 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.368609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-bound-sa-token\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.376306 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.376276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-bound-sa-token\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.376459 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.376439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98qb\" (UniqueName: \"kubernetes.io/projected/98d7f083-b225-4aca-9cdf-8f097747011b-kube-api-access-x98qb\") pod \"cert-manager-59c77684cc-5qnlz\" (UID: \"98d7f083-b225-4aca-9cdf-8f097747011b\") " pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.453189 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.453072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5qnlz" Jun 09 15:08:38.582379 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.582352 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5qnlz"] Jun 09 15:08:38.584454 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:08:38.584426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98d7f083_b225_4aca_9cdf_8f097747011b.slice/crio-a5ff1b759f92ccdf006a28064e2ea7e69375fe1b3767141ebc0557cef56d73e8 WatchSource:0}: Error finding container a5ff1b759f92ccdf006a28064e2ea7e69375fe1b3767141ebc0557cef56d73e8: Status 404 returned error can't find the container with id a5ff1b759f92ccdf006a28064e2ea7e69375fe1b3767141ebc0557cef56d73e8 Jun 09 15:08:38.689865 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.689829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5qnlz" event={"ID":"98d7f083-b225-4aca-9cdf-8f097747011b","Type":"ContainerStarted","Data":"82e9cefb527bd98e9630bf24c4ca711884f487e0d659ab781784e8118a64e81e"} Jun 09 15:08:38.690039 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.689877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5qnlz" event={"ID":"98d7f083-b225-4aca-9cdf-8f097747011b","Type":"ContainerStarted","Data":"a5ff1b759f92ccdf006a28064e2ea7e69375fe1b3767141ebc0557cef56d73e8"} Jun 09 15:08:38.705643 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:38.705550 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5qnlz" podStartSLOduration=0.705535766 podStartE2EDuration="705.535766ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:38.705241345 +0000 UTC m=+465.335444582" watchObservedRunningTime="2026-06-09 15:08:38.705535766 +0000 UTC m=+465.335739005" Jun 09 15:08:52.428089 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.428054 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn"] Jun 09 15:08:52.431782 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.431741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.435858 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.435831 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:08:52.436152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.436115 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:08:52.436152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.436129 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:08:52.436353 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.436206 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z5fwv\"" Jun 09 15:08:52.436440 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.436428 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:08:52.448878 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.448848 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn"] Jun 09 15:08:52.493225 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.493193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.493402 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.493234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.493402 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.493257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xzr\" (UniqueName: \"kubernetes.io/projected/0958a935-65da-4f48-af8a-eecfb90c835e-kube-api-access-r9xzr\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.493402 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.493321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.493402 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.493354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.593728 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.593690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.593907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.593748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.593907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.593773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.593907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.593792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xzr\" (UniqueName: \"kubernetes.io/projected/0958a935-65da-4f48-af8a-eecfb90c835e-kube-api-access-r9xzr\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.593907 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.593819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.594245 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.594226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.596124 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.596101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0958a935-65da-4f48-af8a-eecfb90c835e-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.596372 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.596354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.596443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.596395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0958a935-65da-4f48-af8a-eecfb90c835e-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.602254 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.602223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xzr\" (UniqueName: \"kubernetes.io/projected/0958a935-65da-4f48-af8a-eecfb90c835e-kube-api-access-r9xzr\") pod \"opendatahub-operator-controller-manager-568b7788b7-nchkn\" (UID: \"0958a935-65da-4f48-af8a-eecfb90c835e\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.743198 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.743065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:52.891706 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:52.891676 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn"] Jun 09 15:08:52.894294 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:08:52.894265 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0958a935_65da_4f48_af8a_eecfb90c835e.slice/crio-49cbbd7b1ec385583906fac57e07eeee27af998568221b01599b14074c754ea4 WatchSource:0}: Error finding container 49cbbd7b1ec385583906fac57e07eeee27af998568221b01599b14074c754ea4: Status 404 returned error can't find the container with id 49cbbd7b1ec385583906fac57e07eeee27af998568221b01599b14074c754ea4 Jun 09 15:08:53.754524 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:53.754490 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" event={"ID":"0958a935-65da-4f48-af8a-eecfb90c835e","Type":"ContainerStarted","Data":"49cbbd7b1ec385583906fac57e07eeee27af998568221b01599b14074c754ea4"} Jun 09 15:08:56.773513 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:56.773470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" event={"ID":"0958a935-65da-4f48-af8a-eecfb90c835e","Type":"ContainerStarted","Data":"2b80de8ccaf8498be073b63dbde037e7a73dcbdffe9a40a28c70bc19e42d3f5e"} Jun 09 15:08:57.779577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:57.779544 2563 generic.go:356] "Generic (PLEG): container finished" podID="0958a935-65da-4f48-af8a-eecfb90c835e" containerID="2b80de8ccaf8498be073b63dbde037e7a73dcbdffe9a40a28c70bc19e42d3f5e" exitCode=0 Jun 09 15:08:57.780032 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:57.779626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" event={"ID":"0958a935-65da-4f48-af8a-eecfb90c835e","Type":"ContainerDied","Data":"2b80de8ccaf8498be073b63dbde037e7a73dcbdffe9a40a28c70bc19e42d3f5e"} Jun 09 15:08:58.786261 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:58.786224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" event={"ID":"0958a935-65da-4f48-af8a-eecfb90c835e","Type":"ContainerStarted","Data":"a14b35920ed03f8f5e20f30bb8d254047e329c7371664e3a2220aec040d81b4d"} Jun 09 15:08:58.786660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:58.786307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:08:58.809931 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:08:58.809878 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" podStartSLOduration=2.420397846 podStartE2EDuration="6.80985859s" totalImagesPullingTime="3.359257536s" totalInitContainerRuntime="1.030203208s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:58.80935503 +0000 UTC m=+485.439558270" watchObservedRunningTime="2026-06-09 15:08:58.80985859 +0000 UTC m=+485.440061832" Jun 09 15:09:09.795783 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:09.795750 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-nchkn" Jun 09 15:09:12.914999 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.914956 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn"] Jun 09 15:09:12.923932 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.923901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:12.926878 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.926844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:09:12.927848 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.927810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 15:09:12.927999 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.927878 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 15:09:12.927999 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.927815 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 15:09:12.928379 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.928361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wcscs\"" Jun 09 15:09:12.928516 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.928364 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 15:09:12.930812 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.930784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn"] Jun 09 15:09:12.985622 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.985575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63cdf2f2-c355-4768-a719-f3e4ab31f10e-manager-config\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:12.985840 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.985713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:12.985840 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.985802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-metrics-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:12.985977 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:12.985864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lz9t\" (UniqueName: \"kubernetes.io/projected/63cdf2f2-c355-4768-a719-f3e4ab31f10e-kube-api-access-8lz9t\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.087272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.087236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lz9t\" (UniqueName: \"kubernetes.io/projected/63cdf2f2-c355-4768-a719-f3e4ab31f10e-kube-api-access-8lz9t\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.087492 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.087297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63cdf2f2-c355-4768-a719-f3e4ab31f10e-manager-config\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.087492 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.087376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.087492 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.087418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-metrics-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.088228 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.088196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63cdf2f2-c355-4768-a719-f3e4ab31f10e-manager-config\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.090188 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.090143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.090319 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.090240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63cdf2f2-c355-4768-a719-f3e4ab31f10e-metrics-cert\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.096376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.096350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lz9t\" (UniqueName: \"kubernetes.io/projected/63cdf2f2-c355-4768-a719-f3e4ab31f10e-kube-api-access-8lz9t\") pod \"lws-controller-manager-7647c5764b-p7kwn\" (UID: \"63cdf2f2-c355-4768-a719-f3e4ab31f10e\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.235486 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.235391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:13.372707 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.372672 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn"] Jun 09 15:09:13.375901 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:09:13.375868 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cdf2f2_c355_4768_a719_f3e4ab31f10e.slice/crio-2d03c36830b728941498f659d7857f54a5cd48992f157d0f5eecc76f1bcb8261 WatchSource:0}: Error finding container 2d03c36830b728941498f659d7857f54a5cd48992f157d0f5eecc76f1bcb8261: Status 404 returned error can't find the container with id 2d03c36830b728941498f659d7857f54a5cd48992f157d0f5eecc76f1bcb8261 Jun 09 15:09:13.856028 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:13.855993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" event={"ID":"63cdf2f2-c355-4768-a719-f3e4ab31f10e","Type":"ContainerStarted","Data":"2d03c36830b728941498f659d7857f54a5cd48992f157d0f5eecc76f1bcb8261"} Jun 09 15:09:16.871620 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:16.871587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" event={"ID":"63cdf2f2-c355-4768-a719-f3e4ab31f10e","Type":"ContainerStarted","Data":"3ee6ef3ecaab6387927015ecf0b6a8ee3e24746ee2d8b72d960ae86c007906ca"} Jun 09 15:09:16.872020 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:16.871712 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:16.887696 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:16.887637 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" podStartSLOduration=2.418382677 podStartE2EDuration="4.887588214s" totalImagesPullingTime="2.469205537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:16.887017941 +0000 UTC m=+503.517221184" watchObservedRunningTime="2026-06-09 15:09:16.887588214 +0000 UTC m=+503.517791454" Jun 09 15:09:27.878317 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:27.878286 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-p7kwn" Jun 09 15:09:41.570568 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.570533 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs"] Jun 09 15:09:41.581074 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.581044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.584002 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.583976 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:09:41.584535 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.584505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:09:41.584535 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.584513 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-shz7f\"" Jun 09 15:09:41.584788 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.584771 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 15:09:41.585948 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.585921 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs"] Jun 09 15:09:41.643069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643298 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643566 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.643566 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.643389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbt27\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-kube-api-access-jbt27\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.744713 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.744910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.744910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.744910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.744910 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbt27\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-kube-api-access-jbt27\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745125 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.744927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745125 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745125 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745125 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745125 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745418 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.745834 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.745817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.747222 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.747195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.747495 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.747477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.754039 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.754005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.754212 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.754086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbt27\" (UniqueName: \"kubernetes.io/projected/25b74ac1-cbe2-47be-8ef6-c052c7781a34-kube-api-access-jbt27\") pod \"data-science-gateway-data-science-gateway-class-74759f9795snlrs\" (UID: \"25b74ac1-cbe2-47be-8ef6-c052c7781a34\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:41.894943 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:41.894907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:42.037537 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:42.037513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs"] Jun 09 15:09:42.039674 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:09:42.039644 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b74ac1_cbe2_47be_8ef6_c052c7781a34.slice/crio-b833bf138bae1b28d02d3719c1ff4ec980b4c58ad4ff2f26b63be15607558625 WatchSource:0}: Error finding container b833bf138bae1b28d02d3719c1ff4ec980b4c58ad4ff2f26b63be15607558625: Status 404 returned error can't find the container with id b833bf138bae1b28d02d3719c1ff4ec980b4c58ad4ff2f26b63be15607558625 Jun 09 15:09:42.992831 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:42.992791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" event={"ID":"25b74ac1-cbe2-47be-8ef6-c052c7781a34","Type":"ContainerStarted","Data":"b833bf138bae1b28d02d3719c1ff4ec980b4c58ad4ff2f26b63be15607558625"} Jun 09 15:09:45.052107 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:45.052066 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:09:45.052511 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:45.052154 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:09:45.052511 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:45.052215 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:09:46.008643 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.008600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" event={"ID":"25b74ac1-cbe2-47be-8ef6-c052c7781a34","Type":"ContainerStarted","Data":"970fe4f8c2272dadcffc8ea2fefa3ac54831623ca25359da2945f51df7e13d4e"} Jun 09 15:09:46.030642 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.030567 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" podStartSLOduration=2.020522276 podStartE2EDuration="5.030548334s" totalImagesPullingTime="3.010026058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:46.029199111 +0000 UTC m=+532.659402345" watchObservedRunningTime="2026-06-09 15:09:46.030548334 +0000 UTC m=+532.660751575" Jun 09 15:09:46.293901 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.293803 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67c98df8d7-n5m5t"] Jun 09 15:09:46.297523 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.297495 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.300271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.300237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vtz9q\"" Jun 09 15:09:46.300412 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.300356 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 15:09:46.309021 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.308994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67c98df8d7-n5m5t"] Jun 09 15:09:46.389767 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.389727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966mn\" (UniqueName: \"kubernetes.io/projected/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-kube-api-access-966mn\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.389950 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.389783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-redirect-config\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.491243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.491205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966mn\" (UniqueName: \"kubernetes.io/projected/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-kube-api-access-966mn\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.491407 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.491260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-redirect-config\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.491922 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.491903 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-redirect-config\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.499649 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.499618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966mn\" (UniqueName: \"kubernetes.io/projected/9fdb5996-d9a1-4f51-b273-725ffe08c3bd-kube-api-access-966mn\") pod \"dashboard-redirect-67c98df8d7-n5m5t\" (UID: \"9fdb5996-d9a1-4f51-b273-725ffe08c3bd\") " pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.610097 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.610056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" Jun 09 15:09:46.751475 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.751440 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67c98df8d7-n5m5t"] Jun 09 15:09:46.752261 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:09:46.752229 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdb5996_d9a1_4f51_b273_725ffe08c3bd.slice/crio-3c6ac9a5cbfda81fe7fd2b61d05994e4f186be263d913600ff8556587fa6fdd1 WatchSource:0}: Error finding container 3c6ac9a5cbfda81fe7fd2b61d05994e4f186be263d913600ff8556587fa6fdd1: Status 404 returned error can't find the container with id 3c6ac9a5cbfda81fe7fd2b61d05994e4f186be263d913600ff8556587fa6fdd1 Jun 09 15:09:46.895615 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.895510 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:46.900365 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:46.900339 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:47.014218 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:47.014140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" event={"ID":"9fdb5996-d9a1-4f51-b273-725ffe08c3bd","Type":"ContainerStarted","Data":"3c6ac9a5cbfda81fe7fd2b61d05994e4f186be263d913600ff8556587fa6fdd1"} Jun 09 15:09:47.014421 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:47.014387 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:47.015480 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:47.015459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795snlrs" Jun 09 15:09:49.028682 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:49.028640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" event={"ID":"9fdb5996-d9a1-4f51-b273-725ffe08c3bd","Type":"ContainerStarted","Data":"305eb461437f4cb40f3f8ffd7710d1cf946f7528296785b7346620609ca56a41"} Jun 09 15:09:49.044987 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:09:49.044931 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67c98df8d7-n5m5t" podStartSLOduration=1.245597945 podStartE2EDuration="3.044914348s" totalImagesPullingTime="1.799316403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:49.043583494 +0000 UTC m=+535.673786734" watchObservedRunningTime="2026-06-09 15:09:49.044914348 +0000 UTC m=+535.675117605" Jun 09 15:10:13.100451 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.100410 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:13.105319 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.105291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:13.107940 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.107904 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:10:13.108147 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.107973 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:10:13.108147 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.107996 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t8khn\"" Jun 09 15:10:13.116426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.116397 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:13.244989 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.244950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845hl\" (UniqueName: \"kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl\") pod \"kuadrant-operator-catalog-l7bvw\" (UID: \"e3ce0eb0-17dc-4e72-bc9d-8df43720a484\") " pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:13.346069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.346028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845hl\" (UniqueName: \"kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl\") pod \"kuadrant-operator-catalog-l7bvw\" (UID: \"e3ce0eb0-17dc-4e72-bc9d-8df43720a484\") " pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:13.355251 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.355148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-845hl\" (UniqueName: \"kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl\") pod \"kuadrant-operator-catalog-l7bvw\" (UID: \"e3ce0eb0-17dc-4e72-bc9d-8df43720a484\") " pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:13.417720 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.417676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:13.438648 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.438612 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:13.556035 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.555962 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:13.558502 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:10:13.558470 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ce0eb0_17dc_4e72_bc9d_8df43720a484.slice/crio-8453a26fea9aa156f2626733ae8744697a07e42188c753ac63a6b6ef4f71c590 WatchSource:0}: Error finding container 8453a26fea9aa156f2626733ae8744697a07e42188c753ac63a6b6ef4f71c590: Status 404 returned error can't find the container with id 8453a26fea9aa156f2626733ae8744697a07e42188c753ac63a6b6ef4f71c590 Jun 09 15:10:13.649715 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.649637 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rlvmk"] Jun 09 15:10:13.652538 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.652519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:13.661359 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.661332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rlvmk"] Jun 09 15:10:13.849977 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.849942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmhc7\" (UniqueName: \"kubernetes.io/projected/a0f93f81-a05d-4b72-a08a-8073a41912a3-kube-api-access-bmhc7\") pod \"kuadrant-operator-catalog-rlvmk\" (UID: \"a0f93f81-a05d-4b72-a08a-8073a41912a3\") " pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:13.951433 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.951330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmhc7\" (UniqueName: \"kubernetes.io/projected/a0f93f81-a05d-4b72-a08a-8073a41912a3-kube-api-access-bmhc7\") pod \"kuadrant-operator-catalog-rlvmk\" (UID: \"a0f93f81-a05d-4b72-a08a-8073a41912a3\") " pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:13.961538 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.961473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmhc7\" (UniqueName: \"kubernetes.io/projected/a0f93f81-a05d-4b72-a08a-8073a41912a3-kube-api-access-bmhc7\") pod \"kuadrant-operator-catalog-rlvmk\" (UID: \"a0f93f81-a05d-4b72-a08a-8073a41912a3\") " pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:13.963624 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:13.963599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:14.109888 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:14.109862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rlvmk"] Jun 09 15:10:14.142204 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:10:14.142143 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f93f81_a05d_4b72_a08a_8073a41912a3.slice/crio-df76c08f49c6a0788787370cd30936df3913f10f58a0b11b55e077015e8557ca WatchSource:0}: Error finding container df76c08f49c6a0788787370cd30936df3913f10f58a0b11b55e077015e8557ca: Status 404 returned error can't find the container with id df76c08f49c6a0788787370cd30936df3913f10f58a0b11b55e077015e8557ca Jun 09 15:10:14.148543 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:14.148512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" event={"ID":"e3ce0eb0-17dc-4e72-bc9d-8df43720a484","Type":"ContainerStarted","Data":"8453a26fea9aa156f2626733ae8744697a07e42188c753ac63a6b6ef4f71c590"} Jun 09 15:10:15.156498 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:15.156448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" event={"ID":"a0f93f81-a05d-4b72-a08a-8073a41912a3","Type":"ContainerStarted","Data":"df76c08f49c6a0788787370cd30936df3913f10f58a0b11b55e077015e8557ca"} Jun 09 15:10:16.162991 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.162954 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" event={"ID":"e3ce0eb0-17dc-4e72-bc9d-8df43720a484","Type":"ContainerStarted","Data":"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf"} Jun 09 15:10:16.163490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.163030 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" podUID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" containerName="registry-server" containerID="cri-o://b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf" gracePeriod=2 Jun 09 15:10:16.164828 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.164799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" event={"ID":"a0f93f81-a05d-4b72-a08a-8073a41912a3","Type":"ContainerStarted","Data":"c1104c89eb11812e91e2fb6e2e023c1de7880fff3a5e1174d353e077cf50a009"} Jun 09 15:10:16.181082 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.181014 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" podStartSLOduration=0.727652034 podStartE2EDuration="3.180990461s" totalImagesPullingTime="2.453338427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:10:16.17913852 +0000 UTC m=+562.809341763" watchObservedRunningTime="2026-06-09 15:10:16.180990461 +0000 UTC m=+562.811193700" Jun 09 15:10:16.199305 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.199250 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" podStartSLOduration=1.326610495 podStartE2EDuration="3.199228585s" totalImagesPullingTime="1.87261809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:10:16.196909743 +0000 UTC m=+562.827112984" watchObservedRunningTime="2026-06-09 15:10:16.199228585 +0000 UTC m=+562.829431825" Jun 09 15:10:16.411547 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.411521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l7bvw_e3ce0eb0-17dc-4e72-bc9d-8df43720a484/registry-server/0.log" Jun 09 15:10:16.412642 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.412617 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:16.479410 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.479373 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-845hl\" (UniqueName: \"kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl\") pod \"e3ce0eb0-17dc-4e72-bc9d-8df43720a484\" (UID: \"e3ce0eb0-17dc-4e72-bc9d-8df43720a484\") " Jun 09 15:10:16.481662 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.481627 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl" (OuterVolumeSpecName: "kube-api-access-845hl") pod "e3ce0eb0-17dc-4e72-bc9d-8df43720a484" (UID: "e3ce0eb0-17dc-4e72-bc9d-8df43720a484"). InnerVolumeSpecName "kube-api-access-845hl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:10:16.580722 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:16.580628 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-845hl\" (UniqueName: \"kubernetes.io/projected/e3ce0eb0-17dc-4e72-bc9d-8df43720a484-kube-api-access-845hl\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:10:17.171005 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.170975 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l7bvw_e3ce0eb0-17dc-4e72-bc9d-8df43720a484/registry-server/0.log" Jun 09 15:10:17.171462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.171018 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" containerID="b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf" exitCode=1 Jun 09 15:10:17.171462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.171076 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" Jun 09 15:10:17.171462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.171118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" event={"ID":"e3ce0eb0-17dc-4e72-bc9d-8df43720a484","Type":"ContainerDied","Data":"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf"} Jun 09 15:10:17.171462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.171208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7bvw" event={"ID":"e3ce0eb0-17dc-4e72-bc9d-8df43720a484","Type":"ContainerDied","Data":"8453a26fea9aa156f2626733ae8744697a07e42188c753ac63a6b6ef4f71c590"} Jun 09 15:10:17.171462 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.171234 2563 scope.go:117] "RemoveContainer" containerID="b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf" Jun 09 15:10:17.180902 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.180877 2563 scope.go:117] "RemoveContainer" containerID="b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf" Jun 09 15:10:17.181229 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:10:17.181209 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf\": container with ID starting with b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf not found: ID does not exist" containerID="b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf" Jun 09 15:10:17.181278 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.181240 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf"} err="failed to get container status \"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf\": rpc error: code = NotFound desc = could not find container \"b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf\": container with ID starting with b9aaf0e759da410025a150fa4b2ed8840760fb466055069cbb341ab48ea25baf not found: ID does not exist" Jun 09 15:10:17.193461 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.193430 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:17.196977 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.196942 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7bvw"] Jun 09 15:10:17.843331 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:17.843294 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" path="/var/lib/kubelet/pods/e3ce0eb0-17dc-4e72-bc9d-8df43720a484/volumes" Jun 09 15:10:23.963702 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:23.963666 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:23.964128 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:23.963731 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:23.989036 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:23.989004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:24.230997 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:24.230920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rlvmk" Jun 09 15:10:45.163896 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.163845 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn"] Jun 09 15:10:45.164745 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.164721 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" containerName="registry-server" Jun 09 15:10:45.164745 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.164747 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" containerName="registry-server" Jun 09 15:10:45.164958 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.164944 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ce0eb0-17dc-4e72-bc9d-8df43720a484" containerName="registry-server" Jun 09 15:10:45.167660 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.167632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:45.170754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.170714 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-l26fs\"" Jun 09 15:10:45.173961 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.173934 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn"] Jun 09 15:10:45.262554 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.262509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msnjl\" (UniqueName: \"kubernetes.io/projected/3b424a93-de55-42e1-85f4-59fb48aa4f70-kube-api-access-msnjl\") pod \"authorino-operator-75cc8d5cb7-wbgwn\" (UID: \"3b424a93-de55-42e1-85f4-59fb48aa4f70\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:45.363478 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.363435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msnjl\" (UniqueName: \"kubernetes.io/projected/3b424a93-de55-42e1-85f4-59fb48aa4f70-kube-api-access-msnjl\") pod \"authorino-operator-75cc8d5cb7-wbgwn\" (UID: \"3b424a93-de55-42e1-85f4-59fb48aa4f70\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:45.373044 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.373012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msnjl\" (UniqueName: \"kubernetes.io/projected/3b424a93-de55-42e1-85f4-59fb48aa4f70-kube-api-access-msnjl\") pod \"authorino-operator-75cc8d5cb7-wbgwn\" (UID: \"3b424a93-de55-42e1-85f4-59fb48aa4f70\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:45.481157 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.481073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:45.622809 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:45.622781 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn"] Jun 09 15:10:45.625790 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:10:45.625762 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b424a93_de55_42e1_85f4_59fb48aa4f70.slice/crio-5f1b23f3fe04b1aff9eab19e0921a4596bbada9f7794b47c22e233462805fdb7 WatchSource:0}: Error finding container 5f1b23f3fe04b1aff9eab19e0921a4596bbada9f7794b47c22e233462805fdb7: Status 404 returned error can't find the container with id 5f1b23f3fe04b1aff9eab19e0921a4596bbada9f7794b47c22e233462805fdb7 Jun 09 15:10:46.316276 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:46.316240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" event={"ID":"3b424a93-de55-42e1-85f4-59fb48aa4f70","Type":"ContainerStarted","Data":"5f1b23f3fe04b1aff9eab19e0921a4596bbada9f7794b47c22e233462805fdb7"} Jun 09 15:10:49.333109 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:49.333076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" event={"ID":"3b424a93-de55-42e1-85f4-59fb48aa4f70","Type":"ContainerStarted","Data":"c0f557580946ccd5887e5740f8e67b01cc70252fb3aae9170e5eaf3b9c554829"} Jun 09 15:10:49.333553 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:49.333146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:10:49.384463 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:49.384389 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" podStartSLOduration=1.407925175 podStartE2EDuration="4.384363756s" totalImagesPullingTime="2.976438581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:10:49.381097902 +0000 UTC m=+596.011301143" watchObservedRunningTime="2026-06-09 15:10:49.384363756 +0000 UTC m=+596.014566999" Jun 09 15:10:53.826002 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:53.825971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:10:53.826911 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:53.826893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:10:55.768481 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.768443 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn"] Jun 09 15:10:55.770651 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.770634 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:10:55.776781 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.776753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qk44v\"" Jun 09 15:10:55.796675 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.796631 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn"] Jun 09 15:10:55.866302 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.866264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h497r\" (UniqueName: \"kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r\") pod \"limitador-operator-controller-manager-859d7b78bd-pf9sn\" (UID: \"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:10:55.967777 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.967735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h497r\" (UniqueName: \"kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r\") pod \"limitador-operator-controller-manager-859d7b78bd-pf9sn\" (UID: \"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:10:55.979873 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:55.979835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h497r\" (UniqueName: \"kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r\") pod \"limitador-operator-controller-manager-859d7b78bd-pf9sn\" (UID: \"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:10:56.081090 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:56.081001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:10:56.232224 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:56.232185 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn"] Jun 09 15:10:56.235345 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:10:56.235313 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9861b6ad_3caf_4ac0_b4eb_dbd95971a48e.slice/crio-b8a46467d4f53fe5f333533b3497e202c68ed38e9130ad752769a2e11765b37d WatchSource:0}: Error finding container b8a46467d4f53fe5f333533b3497e202c68ed38e9130ad752769a2e11765b37d: Status 404 returned error can't find the container with id b8a46467d4f53fe5f333533b3497e202c68ed38e9130ad752769a2e11765b37d Jun 09 15:10:56.368233 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:56.368194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" event={"ID":"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e","Type":"ContainerStarted","Data":"b8a46467d4f53fe5f333533b3497e202c68ed38e9130ad752769a2e11765b37d"} Jun 09 15:10:59.384220 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:59.384184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" event={"ID":"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e","Type":"ContainerStarted","Data":"15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda"} Jun 09 15:10:59.421403 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:10:59.421351 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" podStartSLOduration=1.679134481 podStartE2EDuration="4.42133338s" totalImagesPullingTime="2.742198899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:10:59.421014251 +0000 UTC m=+606.051217490" watchObservedRunningTime="2026-06-09 15:10:59.42133338 +0000 UTC m=+606.051536613" Jun 09 15:11:00.341615 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:00.341582 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbgwn" Jun 09 15:11:00.389912 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:00.389883 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:11.396717 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:11.396683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:15.747435 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.747337 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn"] Jun 09 15:11:15.747925 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.747697 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" containerName="manager" containerID="cri-o://15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda" gracePeriod=2 Jun 09 15:11:15.751014 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:11:15.750978 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pf9sn\" is forbidden: User \"system:node:ip-10-0-133-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-102.ec2.internal' and this object" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:15.752088 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.752059 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn"] Jun 09 15:11:15.789378 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.789340 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs"] Jun 09 15:11:15.789947 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.789926 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" containerName="manager" Jun 09 15:11:15.790023 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.789950 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" containerName="manager" Jun 09 15:11:15.790079 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.790059 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" containerName="manager" Jun 09 15:11:15.792532 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.792507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:15.795488 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:11:15.795446 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pf9sn\" is forbidden: User \"system:node:ip-10-0-133-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-102.ec2.internal' and this object" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:15.813229 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.813195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs"] Jun 09 15:11:15.955835 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.955796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vfl\" (UniqueName: \"kubernetes.io/projected/f0d0d1ca-407f-4806-a8f1-6d9269cb1172-kube-api-access-s7vfl\") pod \"limitador-operator-controller-manager-859d7b78bd-cj4gs\" (UID: \"f0d0d1ca-407f-4806-a8f1-6d9269cb1172\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:15.997761 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:15.997693 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:16.057142 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.057099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vfl\" (UniqueName: \"kubernetes.io/projected/f0d0d1ca-407f-4806-a8f1-6d9269cb1172-kube-api-access-s7vfl\") pod \"limitador-operator-controller-manager-859d7b78bd-cj4gs\" (UID: \"f0d0d1ca-407f-4806-a8f1-6d9269cb1172\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:16.071990 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.071949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vfl\" (UniqueName: \"kubernetes.io/projected/f0d0d1ca-407f-4806-a8f1-6d9269cb1172-kube-api-access-s7vfl\") pod \"limitador-operator-controller-manager-859d7b78bd-cj4gs\" (UID: \"f0d0d1ca-407f-4806-a8f1-6d9269cb1172\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:16.130990 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.130948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:16.158356 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.158320 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h497r\" (UniqueName: \"kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r\") pod \"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e\" (UID: \"9861b6ad-3caf-4ac0-b4eb-dbd95971a48e\") " Jun 09 15:11:16.161030 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.160991 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r" (OuterVolumeSpecName: "kube-api-access-h497r") pod "9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" (UID: "9861b6ad-3caf-4ac0-b4eb-dbd95971a48e"). InnerVolumeSpecName "kube-api-access-h497r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:11:16.259684 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.259600 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h497r\" (UniqueName: \"kubernetes.io/projected/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e-kube-api-access-h497r\") on node \"ip-10-0-133-102.ec2.internal\" DevicePath \"\"" Jun 09 15:11:16.307032 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.306993 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs"] Jun 09 15:11:16.310443 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:11:16.310415 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d0d1ca_407f_4806_a8f1_6d9269cb1172.slice/crio-5a767df82a538ecc0857433e85a5d958951b070862dc8d35e0d810e4360c3440 WatchSource:0}: Error finding container 5a767df82a538ecc0857433e85a5d958951b070862dc8d35e0d810e4360c3440: Status 404 returned error can't find the container with id 5a767df82a538ecc0857433e85a5d958951b070862dc8d35e0d810e4360c3440 Jun 09 15:11:16.477738 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.477705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" event={"ID":"f0d0d1ca-407f-4806-a8f1-6d9269cb1172","Type":"ContainerStarted","Data":"34c07b32343a068c2d5ed45b86d369d9d4c6700f40b862902ddb24202a06373d"} Jun 09 15:11:16.477957 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.477767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" event={"ID":"f0d0d1ca-407f-4806-a8f1-6d9269cb1172","Type":"ContainerStarted","Data":"5a767df82a538ecc0857433e85a5d958951b070862dc8d35e0d810e4360c3440"} Jun 09 15:11:16.477957 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.477795 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:16.479019 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.478993 2563 generic.go:356] "Generic (PLEG): container finished" podID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" containerID="15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda" exitCode=0 Jun 09 15:11:16.479133 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.479032 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pf9sn" Jun 09 15:11:16.479133 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.479049 2563 scope.go:117] "RemoveContainer" containerID="15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda" Jun 09 15:11:16.489340 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.489321 2563 scope.go:117] "RemoveContainer" containerID="15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda" Jun 09 15:11:16.489655 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:11:16.489636 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda\": container with ID starting with 15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda not found: ID does not exist" containerID="15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda" Jun 09 15:11:16.489701 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.489665 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda"} err="failed to get container status \"15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda\": rpc error: code = NotFound desc = could not find container \"15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda\": container with ID starting with 15157431ebb08a31e3f1725adc43b1fc8bd11cc56a5230782eb6a287ac4eefda not found: ID does not exist" Jun 09 15:11:16.509406 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:16.509355 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" podStartSLOduration=1.509337113 podStartE2EDuration="1.509337113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:11:16.507795736 +0000 UTC m=+623.137998977" watchObservedRunningTime="2026-06-09 15:11:16.509337113 +0000 UTC m=+623.139540352" Jun 09 15:11:17.842985 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:17.842951 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9861b6ad-3caf-4ac0-b4eb-dbd95971a48e" path="/var/lib/kubelet/pods/9861b6ad-3caf-4ac0-b4eb-dbd95971a48e/volumes" Jun 09 15:11:27.489012 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:27.488979 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cj4gs" Jun 09 15:11:44.626155 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.626118 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf"] Jun 09 15:11:44.629191 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.629151 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.631665 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.631638 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5gh8f\"" Jun 09 15:11:44.645244 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.645210 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf"] Jun 09 15:11:44.722031 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.721989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722031 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclnv\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-kube-api-access-hclnv\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722326 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722326 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722443 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722497 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722497 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722573 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.722609 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.722555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823233 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hclnv\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-kube-api-access-hclnv\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823423 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823820 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823820 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.823820 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.823810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.824028 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.824000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.824185 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.824131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.825585 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.825560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.825842 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.825822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.834296 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.834260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.834446 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.834381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclnv\" (UniqueName: \"kubernetes.io/projected/eca84129-b150-4f9e-b3c4-71d091f6b7bc-kube-api-access-hclnv\") pod \"maas-default-gateway-openshift-default-687ff6996-hqkpf\" (UID: \"eca84129-b150-4f9e-b3c4-71d091f6b7bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:44.939891 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:44.939803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:45.085782 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.085754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf"] Jun 09 15:11:45.087810 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:11:45.087778 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca84129_b150_4f9e_b3c4_71d091f6b7bc.slice/crio-874cf5fca58248c795d185c775e5afdd33a28fff6d44eee849b4a1444ca8bc83 WatchSource:0}: Error finding container 874cf5fca58248c795d185c775e5afdd33a28fff6d44eee849b4a1444ca8bc83: Status 404 returned error can't find the container with id 874cf5fca58248c795d185c775e5afdd33a28fff6d44eee849b4a1444ca8bc83 Jun 09 15:11:45.089969 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.089939 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:11:45.090085 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.090011 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:11:45.090085 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.090060 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:11:45.633073 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.633036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" event={"ID":"eca84129-b150-4f9e-b3c4-71d091f6b7bc","Type":"ContainerStarted","Data":"c2baeeb7f295fc40c0e836b15d0b6831dbfdf138a8ab968907653ceb9a7a8aba"} Jun 09 15:11:45.633503 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.633094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" event={"ID":"eca84129-b150-4f9e-b3c4-71d091f6b7bc","Type":"ContainerStarted","Data":"874cf5fca58248c795d185c775e5afdd33a28fff6d44eee849b4a1444ca8bc83"} Jun 09 15:11:45.659478 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.659428 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" podStartSLOduration=1.6594090449999999 podStartE2EDuration="1.659409045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:11:45.657821778 +0000 UTC m=+652.288025020" watchObservedRunningTime="2026-06-09 15:11:45.659409045 +0000 UTC m=+652.289612284" Jun 09 15:11:45.940469 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:45.940375 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:46.945965 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:46.945939 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:47.643602 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:47.643574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:11:47.644692 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:11:47.644671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:12:01.247045 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.247008 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:12:01.250629 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.250604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.255531 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.255506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 15:12:01.255768 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.255753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pk677\"" Jun 09 15:12:01.272031 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.271997 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:12:01.338614 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.338577 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:12:01.385253 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.385212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-config-file\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.385253 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.385258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqn4m\" (UniqueName: \"kubernetes.io/projected/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-kube-api-access-rqn4m\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.486747 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.486708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-config-file\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.486747 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.486750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqn4m\" (UniqueName: \"kubernetes.io/projected/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-kube-api-access-rqn4m\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.487422 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.487399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-config-file\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.500937 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.500870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqn4m\" (UniqueName: \"kubernetes.io/projected/305961cb-d925-4cd5-8425-f7b8f0eb8d5a-kube-api-access-rqn4m\") pod \"limitador-limitador-54d6d988d5-99zvw\" (UID: \"305961cb-d925-4cd5-8425-f7b8f0eb8d5a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.560892 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.560855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:01.737218 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:01.737189 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:12:01.740202 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:12:01.740142 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305961cb_d925_4cd5_8425_f7b8f0eb8d5a.slice/crio-bb991282be490623040f5970e3ed7c0dd0b085fb5930cbe6389f06c592ff0596 WatchSource:0}: Error finding container bb991282be490623040f5970e3ed7c0dd0b085fb5930cbe6389f06c592ff0596: Status 404 returned error can't find the container with id bb991282be490623040f5970e3ed7c0dd0b085fb5930cbe6389f06c592ff0596 Jun 09 15:12:02.722174 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:02.722119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" event={"ID":"305961cb-d925-4cd5-8425-f7b8f0eb8d5a","Type":"ContainerStarted","Data":"bb991282be490623040f5970e3ed7c0dd0b085fb5930cbe6389f06c592ff0596"} Jun 09 15:12:04.734811 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:04.734772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" event={"ID":"305961cb-d925-4cd5-8425-f7b8f0eb8d5a","Type":"ContainerStarted","Data":"6a472a39c05f3d9285597dc490ada0c295f36e23f368171ff37d37a11272f9b6"} Jun 09 15:12:04.735321 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:04.734888 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:15.740490 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:15.740459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" Jun 09 15:12:15.760243 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:12:15.760185 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-99zvw" podStartSLOduration=12.42120553 podStartE2EDuration="14.76014743s" totalImagesPullingTime="2.3389419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:04.791260529 +0000 UTC m=+671.421463770" watchObservedRunningTime="2026-06-09 15:12:15.76014743 +0000 UTC m=+682.390350669" Jun 09 15:14:14.639013 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.638929 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6fw2d"] Jun 09 15:14:14.642581 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.642553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:14.644510 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.644479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:14:14.645754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.645728 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 15:14:14.645754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.645744 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-794vj\"" Jun 09 15:14:14.651240 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.650945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5h5p\" (UniqueName: \"kubernetes.io/projected/05bb2b7e-f895-4447-8f45-59abf93d1f4e-kube-api-access-j5h5p\") pod \"payload-processing-7c6c859784-6fw2d\" (UID: \"05bb2b7e-f895-4447-8f45-59abf93d1f4e\") " pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:14.652272 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.652248 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6fw2d"] Jun 09 15:14:14.752113 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.752070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5h5p\" (UniqueName: \"kubernetes.io/projected/05bb2b7e-f895-4447-8f45-59abf93d1f4e-kube-api-access-j5h5p\") pod \"payload-processing-7c6c859784-6fw2d\" (UID: \"05bb2b7e-f895-4447-8f45-59abf93d1f4e\") " pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:14.761998 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.761964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5h5p\" (UniqueName: \"kubernetes.io/projected/05bb2b7e-f895-4447-8f45-59abf93d1f4e-kube-api-access-j5h5p\") pod \"payload-processing-7c6c859784-6fw2d\" (UID: \"05bb2b7e-f895-4447-8f45-59abf93d1f4e\") " pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:14.954442 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:14.954355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:15.097050 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:15.097013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6fw2d"] Jun 09 15:14:15.103854 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:15.103836 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:14:15.400781 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:15.400740 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"54a7a947941f790c8615a95d3a3be04c382e9d02b2c94a3b8130aff78f5c7d37"} Jun 09 15:14:18.420210 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:18.420151 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"bba8ebabf5874a0606147ff0bc96402338c1fe842108f286c5c2393c249530b4"} Jun 09 15:14:18.420614 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:18.420323 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:14:18.438787 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:18.438739 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podStartSLOduration=1.256381207 podStartE2EDuration="4.438723901s" totalImagesPullingTime="3.182342694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:18.437229043 +0000 UTC m=+805.067432304" watchObservedRunningTime="2026-06-09 15:14:18.438723901 +0000 UTC m=+805.068927140" Jun 09 15:14:22.443728 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.443693 2563 generic.go:356] "Generic (PLEG): container finished" podID="eca84129-b150-4f9e-b3c4-71d091f6b7bc" containerID="c2baeeb7f295fc40c0e836b15d0b6831dbfdf138a8ab968907653ceb9a7a8aba" exitCode=0 Jun 09 15:14:22.444123 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.443772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" event={"ID":"eca84129-b150-4f9e-b3c4-71d091f6b7bc","Type":"ContainerDied","Data":"c2baeeb7f295fc40c0e836b15d0b6831dbfdf138a8ab968907653ceb9a7a8aba"} Jun 09 15:14:22.444227 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.444212 2563 scope.go:117] "RemoveContainer" containerID="c2baeeb7f295fc40c0e836b15d0b6831dbfdf138a8ab968907653ceb9a7a8aba" Jun 09 15:14:22.445235 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.445207 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:14:22.445348 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.445312 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:14:22.445420 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:22.445361 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 15:14:23.453376 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:23.453329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" event={"ID":"eca84129-b150-4f9e-b3c4-71d091f6b7bc","Type":"ContainerStarted","Data":"7bf918bbf325624fe902fbf9036ba2a66dce900ae6aa63434bb705b8dad82380"} Jun 09 15:14:23.940471 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:23.940425 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:14:23.940684 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:23.940661 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hqkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jun 09 15:14:23.940754 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:23.940709 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" podUID="eca84129-b150-4f9e-b3c4-71d091f6b7bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jun 09 15:14:24.941055 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:24.941017 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hqkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jun 09 15:14:24.941507 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:24.941091 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" podUID="eca84129-b150-4f9e-b3c4-71d091f6b7bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jun 09 15:14:25.940557 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:25.940519 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hqkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jun 09 15:14:25.940749 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:25.940578 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" podUID="eca84129-b150-4f9e-b3c4-71d091f6b7bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jun 09 15:14:26.941055 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:26.941014 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-hqkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jun 09 15:14:26.941449 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:26.941106 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" podUID="eca84129-b150-4f9e-b3c4-71d091f6b7bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jun 09 15:14:27.944639 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:27.944608 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:14:27.945021 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:27.944898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:14:27.945530 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:27.945513 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-hqkpf" Jun 09 15:14:29.427631 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:14:29.427597 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:15:28.975371 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:15:28.975331 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:15:41.943734 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:15:41.943693 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:15:53.861082 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:15:53.861002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:15:53.863379 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:15:53.863353 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:15:55.759069 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:15:55.759029 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:16:07.250254 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:07.250215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:16:14.054891 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:14.054846 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:16:19.062232 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:19.062194 2563 generic.go:356] "Generic (PLEG): container finished" podID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" containerID="bba8ebabf5874a0606147ff0bc96402338c1fe842108f286c5c2393c249530b4" exitCode=1 Jun 09 15:16:19.062716 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:19.062280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerDied","Data":"bba8ebabf5874a0606147ff0bc96402338c1fe842108f286c5c2393c249530b4"} Jun 09 15:16:19.062716 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:19.062683 2563 scope.go:117] "RemoveContainer" containerID="bba8ebabf5874a0606147ff0bc96402338c1fe842108f286c5c2393c249530b4" Jun 09 15:16:19.425982 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:19.425947 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:16:20.069598 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:20.069558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac"} Jun 09 15:16:20.070010 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:20.069717 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:16:23.151685 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:23.151648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:16:31.076467 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:16:31.076427 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:18:19.693378 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:19.693336 2563 generic.go:356] "Generic (PLEG): container finished" podID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" containerID="ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac" exitCode=1 Jun 09 15:18:19.693837 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:19.693374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerDied","Data":"ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac"} Jun 09 15:18:19.693837 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:19.693476 2563 scope.go:117] "RemoveContainer" containerID="bba8ebabf5874a0606147ff0bc96402338c1fe842108f286c5c2393c249530b4" Jun 09 15:18:19.693837 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:19.693827 2563 scope.go:117] "RemoveContainer" containerID="ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac" Jun 09 15:18:19.694129 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:18:19.694108 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:18:21.075574 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:21.075536 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:18:21.075968 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:21.075921 2563 scope.go:117] "RemoveContainer" containerID="ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac" Jun 09 15:18:21.076227 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:18:21.076201 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:18:31.837429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:31.837393 2563 scope.go:117] "RemoveContainer" containerID="ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac" Jun 09 15:18:32.763078 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:32.763043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c"} Jun 09 15:18:42.763779 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:42.763739 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:18:42.765336 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:18:42.765307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:19:45.370426 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:19:45.370387 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:19:49.084990 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:19:49.084948 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:19:56.853987 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:19:56.853950 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:07.056240 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:07.056196 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:15.953470 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:15.953383 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:26.051617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:26.051574 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:32.368878 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:32.368840 2563 generic.go:356] "Generic (PLEG): container finished" podID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" exitCode=1 Jun 09 15:20:32.369429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:32.368878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerDied","Data":"2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c"} Jun 09 15:20:32.369429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:32.368943 2563 scope.go:117] "RemoveContainer" containerID="ee3f5d1fd6d4d70a98b0e8ce8c09c91e0707beae81eba2e5ba7ac765882b66ac" Jun 09 15:20:32.369429 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:32.369353 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:20:32.369637 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:20:32.369616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:20:32.765671 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:32.765584 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:20:33.376132 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:33.376103 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:20:33.376531 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:20:33.376318 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:20:34.955290 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:34.955245 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:20:34.955790 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:34.955700 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:20:34.955922 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:20:34.955897 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:20:35.450970 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:35.450933 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:45.947991 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:45.947951 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:20:48.837136 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:48.837102 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:20:48.837633 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:20:48.837350 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:20:53.893483 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:53.893453 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:20:53.899758 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:53.899723 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:20:59.837645 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:20:59.837615 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:21:00.514127 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:00.514086 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72"} Jun 09 15:21:00.514469 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:00.514449 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:21:11.522227 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:11.522193 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:21:18.645003 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:18.644969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:21:21.752062 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:21.752023 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:21:58.446377 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:21:58.446287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:22:14.742553 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:22:14.742517 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:22:52.460464 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:22:52.460425 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:23:00.133887 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:00.133853 2563 generic.go:356] "Generic (PLEG): container finished" podID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" exitCode=1 Jun 09 15:23:00.134320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:00.133920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerDied","Data":"8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72"} Jun 09 15:23:00.134320 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:00.133983 2563 scope.go:117] "RemoveContainer" containerID="2fbf7140e8eeba93269c5609cc7b70ff38e91e2b5549dcaab3ebab85ace7663c" Jun 09 15:23:00.134428 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:00.134370 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:00.134623 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:23:00.134599 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:23:01.520577 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:01.520529 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:23:01.520990 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:01.520869 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:01.521103 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:23:01.521083 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:23:09.640432 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:09.640390 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:23:12.836979 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:12.836949 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:12.837413 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:23:12.837194 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:23:14.955259 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:14.955147 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:23:14.955650 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:14.955543 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:14.955783 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:23:14.955763 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:23:23.649129 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:23.649084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:23:28.837676 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:28.837641 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:28.838059 ip-10-0-133-102 kubenswrapper[2563]: E0609 15:23:28.837860 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-6fw2d_openshift-ingress(05bb2b7e-f895-4447-8f45-59abf93d1f4e)\"" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" podUID="05bb2b7e-f895-4447-8f45-59abf93d1f4e" Jun 09 15:23:38.758027 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:38.757986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:23:41.854834 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:41.854801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-99zvw"] Jun 09 15:23:43.839661 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:43.839629 2563 scope.go:117] "RemoveContainer" containerID="8c5818d833ce49be9459ecb6a40c34ca4cf467137ea6e8116c46556998eb4a72" Jun 09 15:23:44.358591 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:44.358545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" event={"ID":"05bb2b7e-f895-4447-8f45-59abf93d1f4e","Type":"ContainerStarted","Data":"fb3f49d72d923e69195740208fbb6960c651ced423adf04863feef6680366368"} Jun 09 15:23:44.358797 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:44.358780 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:23:55.366101 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:55.366065 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6fw2d" Jun 09 15:23:57.940199 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:57.940144 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67c98df8d7-n5m5t_9fdb5996-d9a1-4f51-b273-725ffe08c3bd/nginx/0.log" Jun 09 15:23:58.857709 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:58.857677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-nchkn_0958a935-65da-4f48-af8a-eecfb90c835e/copy-manifests/0.log" Jun 09 15:23:58.868947 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:23:58.868917 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-nchkn_0958a935-65da-4f48-af8a-eecfb90c835e/manager/0.log" Jun 09 15:24:00.190420 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:00.190388 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wbgwn_3b424a93-de55-42e1-85f4-59fb48aa4f70/manager/0.log" Jun 09 15:24:00.510067 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:00.509978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rlvmk_a0f93f81-a05d-4b72-a08a-8073a41912a3/registry-server/0.log" Jun 09 15:24:00.732491 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:00.732460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-99zvw_305961cb-d925-4cd5-8425-f7b8f0eb8d5a/limitador/0.log" Jun 09 15:24:00.858749 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:00.858715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cj4gs_f0d0d1ca-407f-4806-a8f1-6d9269cb1172/manager/0.log" Jun 09 15:24:01.192236 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:01.192130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795snlrs_25b74ac1-cbe2-47be-8ef6-c052c7781a34/istio-proxy/0.log" Jun 09 15:24:01.644597 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:01.644569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/1.log" Jun 09 15:24:01.866342 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:01.866302 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/4.log" Jun 09 15:24:06.579438 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.579402 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rnqb/must-gather-9z6hq"] Jun 09 15:24:06.583138 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.583115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.585919 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.585891 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rnqb\"/\"kube-root-ca.crt\"" Jun 09 15:24:06.586042 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.585934 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rnqb\"/\"openshift-service-ca.crt\"" Jun 09 15:24:06.586152 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.586136 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4rnqb\"/\"default-dockercfg-dwcff\"" Jun 09 15:24:06.593388 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.593363 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/must-gather-9z6hq"] Jun 09 15:24:06.710625 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.710580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e6fec7e-86a3-4db2-aaea-d11504384f69-must-gather-output\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.710625 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.710621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv67d\" (UniqueName: \"kubernetes.io/projected/7e6fec7e-86a3-4db2-aaea-d11504384f69-kube-api-access-kv67d\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.811807 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.811768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e6fec7e-86a3-4db2-aaea-d11504384f69-must-gather-output\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.811807 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.811806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv67d\" (UniqueName: \"kubernetes.io/projected/7e6fec7e-86a3-4db2-aaea-d11504384f69-kube-api-access-kv67d\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.812220 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.812196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e6fec7e-86a3-4db2-aaea-d11504384f69-must-gather-output\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.820394 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.820372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv67d\" (UniqueName: \"kubernetes.io/projected/7e6fec7e-86a3-4db2-aaea-d11504384f69-kube-api-access-kv67d\") pod \"must-gather-9z6hq\" (UID: \"7e6fec7e-86a3-4db2-aaea-d11504384f69\") " pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:06.893555 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:06.893513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" Jun 09 15:24:07.040226 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:07.040198 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/must-gather-9z6hq"] Jun 09 15:24:07.041729 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:24:07.041701 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e6fec7e_86a3_4db2_aaea_d11504384f69.slice/crio-ac36dac180ea574e225108b227f5d135bd0f387ebb82435f3389a1d34ad5acc7 WatchSource:0}: Error finding container ac36dac180ea574e225108b227f5d135bd0f387ebb82435f3389a1d34ad5acc7: Status 404 returned error can't find the container with id ac36dac180ea574e225108b227f5d135bd0f387ebb82435f3389a1d34ad5acc7 Jun 09 15:24:07.043594 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:07.043577 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:24:07.484955 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:07.484913 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" event={"ID":"7e6fec7e-86a3-4db2-aaea-d11504384f69","Type":"ContainerStarted","Data":"ac36dac180ea574e225108b227f5d135bd0f387ebb82435f3389a1d34ad5acc7"} Jun 09 15:24:08.495441 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:08.495401 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" event={"ID":"7e6fec7e-86a3-4db2-aaea-d11504384f69","Type":"ContainerStarted","Data":"6e5324dd0d768cddbaa8fd79c8c242b13c4bff4fa84d945ea76c039b73d14e0e"} Jun 09 15:24:08.495900 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:08.495454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" event={"ID":"7e6fec7e-86a3-4db2-aaea-d11504384f69","Type":"ContainerStarted","Data":"526d4f2416ff8526e8d87c5aef602de233cb17e7fd157056276f537c49439c71"} Jun 09 15:24:08.511560 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:08.511499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rnqb/must-gather-9z6hq" podStartSLOduration=1.506608281 podStartE2EDuration="2.511476343s" totalImagesPullingTime="1.004868062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:08.511406211 +0000 UTC m=+1395.141609452" watchObservedRunningTime="2026-06-09 15:24:08.511476343 +0000 UTC m=+1395.141679583" Jun 09 15:24:09.804405 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:09.804375 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wcw9w_cf3cd76b-1e7e-4707-8764-fc7e2c806921/global-pull-secret-syncer/0.log" Jun 09 15:24:09.904280 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:09.904247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zq96d_c1d8f273-7739-4604-ab6e-40586464a82c/konnectivity-agent/0.log" Jun 09 15:24:09.926058 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:09.926008 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-102.ec2.internal_e2f90cf2738dff4fcdeb8e9438957c52/haproxy/0.log" Jun 09 15:24:14.727076 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:14.727038 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wbgwn_3b424a93-de55-42e1-85f4-59fb48aa4f70/manager/0.log" Jun 09 15:24:14.891271 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:14.891237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rlvmk_a0f93f81-a05d-4b72-a08a-8073a41912a3/registry-server/0.log" Jun 09 15:24:14.969569 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:14.969543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-99zvw_305961cb-d925-4cd5-8425-f7b8f0eb8d5a/limitador/0.log" Jun 09 15:24:15.005528 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:15.005490 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cj4gs_f0d0d1ca-407f-4806-a8f1-6d9269cb1172/manager/0.log" Jun 09 15:24:16.831151 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.831123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/alertmanager/0.log" Jun 09 15:24:16.870405 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.870376 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/config-reloader/0.log" Jun 09 15:24:16.898512 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.898479 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/kube-rbac-proxy-web/0.log" Jun 09 15:24:16.929610 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.929582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/kube-rbac-proxy/0.log" Jun 09 15:24:16.960963 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.960934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/kube-rbac-proxy-metric/0.log" Jun 09 15:24:16.985940 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:16.985910 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/prom-label-proxy/0.log" Jun 09 15:24:17.018811 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.018775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a1523c7-9111-4238-849f-0adf29799405/init-config-reloader/0.log" Jun 09 15:24:17.057656 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.057621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/1.log" Jun 09 15:24:17.213189 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.213037 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-svf78_e58479b6-83db-4c20-91fd-f0d378e402b4/cluster-monitoring-operator/0.log" Jun 09 15:24:17.246743 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.246704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-state-metrics/0.log" Jun 09 15:24:17.268375 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.268323 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-rbac-proxy-main/0.log" Jun 09 15:24:17.291133 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.291086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-tnrzp_865ba19a-915d-4c21-9bd1-25f567b13c79/kube-rbac-proxy-self/0.log" Jun 09 15:24:17.599906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.599833 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/node-exporter/0.log" Jun 09 15:24:17.652906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.652859 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/kube-rbac-proxy/0.log" Jun 09 15:24:17.689883 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.689795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv8v_480ce491-cdb3-4cc0-9417-e7d918412858/init-textfile/0.log" Jun 09 15:24:17.731944 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.731906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/kube-rbac-proxy-main/0.log" Jun 09 15:24:17.764594 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.764568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/kube-rbac-proxy-self/0.log" Jun 09 15:24:17.795076 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.794990 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xrhts_bd0af667-3455-4aec-a122-f5bd6773bc6a/openshift-state-metrics/0.log" Jun 09 15:24:17.835542 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.835077 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/prometheus/0.log" Jun 09 15:24:17.861798 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.861768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/config-reloader/0.log" Jun 09 15:24:17.891076 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.891043 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/thanos-sidecar/0.log" Jun 09 15:24:17.915906 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.915877 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/kube-rbac-proxy-web/0.log" Jun 09 15:24:17.942897 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.942871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/kube-rbac-proxy/0.log" Jun 09 15:24:17.964596 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:17.964546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/kube-rbac-proxy-thanos/0.log" Jun 09 15:24:18.001101 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:18.001061 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_27708be4-5f5c-4969-b132-614e414e088d/init-config-reloader/0.log" Jun 09 15:24:18.079690 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:18.079594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-stffx_1797c1ba-16f5-403c-b197-33ca2ae47069/prometheus-operator-admission-webhook/0.log" Jun 09 15:24:18.109468 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:18.109431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/telemeter-client/0.log" Jun 09 15:24:18.146475 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:18.146440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/reload/0.log" Jun 09 15:24:18.167935 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:18.167904 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bcdcf89b-x924p_92a89e6a-98f1-4b6d-a39f-d4d5d87ba1af/kube-rbac-proxy/0.log" Jun 09 15:24:21.409941 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.409896 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb"] Jun 09 15:24:21.418039 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.418010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.423617 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.423582 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb"] Jun 09 15:24:21.466745 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.466702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-sys\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.466929 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.466809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-lib-modules\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.466929 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.466869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-podres\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.466929 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.466901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jmc\" (UniqueName: \"kubernetes.io/projected/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-kube-api-access-55jmc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.467076 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.466936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-proc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.567931 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.567887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-proc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568126 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-sys\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568126 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-lib-modules\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568126 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-podres\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568329 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jmc\" (UniqueName: \"kubernetes.io/projected/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-kube-api-access-55jmc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568598 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-proc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568712 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-sys\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568799 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-lib-modules\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.568901 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.568868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-podres\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.575761 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.575727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jmc\" (UniqueName: \"kubernetes.io/projected/936ad7d8-0b8d-4c36-8d64-ae1ce39775aa-kube-api-access-55jmc\") pod \"perf-node-gather-daemonset-x2rvb\" (UID: \"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.735215 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.735099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:21.923856 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:21.923754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb"] Jun 09 15:24:21.925380 ip-10-0-133-102 kubenswrapper[2563]: W0609 15:24:21.925334 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod936ad7d8_0b8d_4c36_8d64_ae1ce39775aa.slice/crio-20d47477591d239782f672a2b32a0923835f9810570213abd514ed738225e867 WatchSource:0}: Error finding container 20d47477591d239782f672a2b32a0923835f9810570213abd514ed738225e867: Status 404 returned error can't find the container with id 20d47477591d239782f672a2b32a0923835f9810570213abd514ed738225e867 Jun 09 15:24:22.608449 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:22.608412 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" event={"ID":"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa","Type":"ContainerStarted","Data":"c03582e60fed420f3d6245f2cc19cc40697e42b7d7a8f988e66f97351f788f61"} Jun 09 15:24:22.608908 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:22.608480 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:22.608908 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:22.608505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" event={"ID":"936ad7d8-0b8d-4c36-8d64-ae1ce39775aa","Type":"ContainerStarted","Data":"20d47477591d239782f672a2b32a0923835f9810570213abd514ed738225e867"} Jun 09 15:24:22.624393 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:22.624333 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" podStartSLOduration=1.624313099 podStartE2EDuration="1.624313099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:22.623652651 +0000 UTC m=+1409.253855890" watchObservedRunningTime="2026-06-09 15:24:22.624313099 +0000 UTC m=+1409.254516340" Jun 09 15:24:23.004953 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:23.004873 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmlqd_cf692b1c-dee2-46b4-9d86-706ec5bc51db/dns/0.log" Jun 09 15:24:23.024908 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:23.024878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmlqd_cf692b1c-dee2-46b4-9d86-706ec5bc51db/kube-rbac-proxy/0.log" Jun 09 15:24:23.088304 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:23.088273 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrdfn_8ee049a3-ac31-42dd-aec3-ae7044f01c66/dns-node-resolver/0.log" Jun 09 15:24:23.651330 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:23.651289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4lzw_dd337ebb-9c52-4890-adb4-0645c3b2b784/node-ca/0.log" Jun 09 15:24:24.598346 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:24.598316 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795snlrs_25b74ac1-cbe2-47be-8ef6-c052c7781a34/istio-proxy/0.log" Jun 09 15:24:24.718762 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:24.718718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/0.log" Jun 09 15:24:24.742552 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:24.742518 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/1.log" Jun 09 15:24:24.790401 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:24.790356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/4.log" Jun 09 15:24:24.797614 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:24.797586 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/3.log" Jun 09 15:24:25.464812 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:25.464773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cf2d_48761377-1856-4b2d-875c-c9e706bd9f8f/serve-healthcheck-canary/0.log" Jun 09 15:24:25.986737 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:25.986702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ftck8_44791603-2b8f-4b33-bc0b-c920bc34cb1f/insights-operator/0.log" Jun 09 15:24:25.990518 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:25.990490 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-ftck8_44791603-2b8f-4b33-bc0b-c920bc34cb1f/insights-operator/1.log" Jun 09 15:24:26.174084 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:26.174049 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnrwb_e3c831c0-d884-4b22-af79-b93edddf0ad5/kube-rbac-proxy/0.log" Jun 09 15:24:26.193994 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:26.193932 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnrwb_e3c831c0-d884-4b22-af79-b93edddf0ad5/exporter/0.log" Jun 09 15:24:26.214381 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:26.214353 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnrwb_e3c831c0-d884-4b22-af79-b93edddf0ad5/extractor/0.log" Jun 09 15:24:28.413229 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:28.413199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67c98df8d7-n5m5t_9fdb5996-d9a1-4f51-b273-725ffe08c3bd/nginx/0.log" Jun 09 15:24:28.628923 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:28.628893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-x2rvb" Jun 09 15:24:28.721692 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:28.721589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-nchkn_0958a935-65da-4f48-af8a-eecfb90c835e/manager/0.log" Jun 09 15:24:28.742395 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:28.742371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-nchkn_0958a935-65da-4f48-af8a-eecfb90c835e/copy-manifests/0.log" Jun 09 15:24:30.321599 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:30.321500 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7647c5764b-p7kwn_63cdf2f2-c355-4768-a719-f3e4ab31f10e/manager/0.log" Jun 09 15:24:35.820438 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:35.820408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795snlrs_25b74ac1-cbe2-47be-8ef6-c052c7781a34/istio-proxy/0.log" Jun 09 15:24:35.916715 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:35.916680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/0.log" Jun 09 15:24:35.931414 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:35.931382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/1.log" Jun 09 15:24:35.964971 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:35.964939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/4.log" Jun 09 15:24:35.971641 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:35.971609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/3.log" Jun 09 15:24:36.260733 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:36.260696 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-q8jnf_427a5d5c-7dc1-4991-b731-2a70b934aa64/kube-storage-version-migrator-operator/1.log" Jun 09 15:24:36.262424 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:36.262399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-q8jnf_427a5d5c-7dc1-4991-b731-2a70b934aa64/kube-storage-version-migrator-operator/0.log" Jun 09 15:24:37.106967 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.106921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795snlrs_25b74ac1-cbe2-47be-8ef6-c052c7781a34/istio-proxy/0.log" Jun 09 15:24:37.269857 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.269810 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/0.log" Jun 09 15:24:37.284708 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.284671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/1.log" Jun 09 15:24:37.327620 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.327574 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/4.log" Jun 09 15:24:37.333043 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.333011 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/3.log" Jun 09 15:24:37.504261 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.504174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7s62s_c5081652-1310-458a-9462-521d0ccb4ec4/kube-multus/0.log" Jun 09 15:24:37.572482 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.572458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/kube-multus-additional-cni-plugins/0.log" Jun 09 15:24:37.599698 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.599664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/egress-router-binary-copy/0.log" Jun 09 15:24:37.622427 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.622399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/cni-plugins/0.log" Jun 09 15:24:37.643497 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.643461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/bond-cni-plugin/0.log" Jun 09 15:24:37.670002 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.669974 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/routeoverride-cni/0.log" Jun 09 15:24:37.701703 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.701667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/whereabouts-cni-bincopy/0.log" Jun 09 15:24:37.731817 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:37.731784 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cx58x_d5361ddb-922a-43cc-90bf-8543dc502c35/whereabouts-cni/0.log" Jun 09 15:24:38.322192 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:38.322135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vnw84_96d6550e-0be0-4b01-bac3-dac2924a6f04/network-metrics-daemon/0.log" Jun 09 15:24:38.358946 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:38.358914 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vnw84_96d6550e-0be0-4b01-bac3-dac2924a6f04/kube-rbac-proxy/0.log" Jun 09 15:24:38.875389 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:38.875358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795snlrs_25b74ac1-cbe2-47be-8ef6-c052c7781a34/istio-proxy/0.log" Jun 09 15:24:38.978715 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:38.978667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/0.log" Jun 09 15:24:38.995584 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:38.995544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-hqkpf_eca84129-b150-4f9e-b3c4-71d091f6b7bc/istio-proxy/1.log" Jun 09 15:24:39.027532 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:39.027501 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/4.log" Jun 09 15:24:39.034214 ip-10-0-133-102 kubenswrapper[2563]: I0609 15:24:39.034176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6fw2d_05bb2b7e-f895-4447-8f45-59abf93d1f4e/payload-processing/3.log"