Jun 08 22:47:37.326727 ip-10-0-141-245 systemd[1]: Starting Kubernetes Kubelet... Jun 08 22:47:37.736437 ip-10-0-141-245 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 22:47:37.736437 ip-10-0-141-245 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 22:47:37.736437 ip-10-0-141-245 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 22:47:37.736437 ip-10-0-141-245 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 22:47:37.736437 ip-10-0-141-245 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 22:47:37.737716 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.736587 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 22:47:37.743296 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743275 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.743296 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743293 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.743296 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743298 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743304 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743308 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743312 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743316 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743320 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743324 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743327 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743331 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743335 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743339 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743343 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743346 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743350 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743354 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743358 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743362 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743367 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743371 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.743526 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743375 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743387 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743392 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743395 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743399 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743403 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743407 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743416 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743434 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743438 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743442 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743446 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743450 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743455 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743459 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743466 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743473 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743479 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743485 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743490 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.744292 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743494 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743502 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743508 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743512 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743517 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743522 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743529 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743533 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743538 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743543 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743547 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743552 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743558 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743564 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743569 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743574 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743578 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743583 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743587 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.745131 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743591 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743596 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743600 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743604 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743608 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743612 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743619 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743623 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743629 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743634 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743638 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743643 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743647 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743651 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743656 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743660 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743665 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743669 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743673 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743677 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.745943 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743682 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743687 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743691 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743695 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743699 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743703 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743707 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743711 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743715 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743720 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743724 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743728 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743732 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743736 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743741 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743745 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743749 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743753 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.743757 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744911 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.746795 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744920 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744925 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744929 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744934 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744939 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744944 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744948 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744952 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744958 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744963 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744968 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744972 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744977 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744983 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744987 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744991 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744995 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.744999 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745004 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.747724 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745008 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745012 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745017 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745021 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745025 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745030 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745034 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745039 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745043 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745047 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745052 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745057 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745061 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745066 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745070 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745074 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745079 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745083 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745087 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745091 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.748404 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745095 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745100 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745104 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745108 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745112 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745116 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745120 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745126 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745130 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745135 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745142 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745148 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745153 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745158 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745163 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745168 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745173 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745178 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745183 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.749019 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745187 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745192 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745198 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745204 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745209 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745213 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745218 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745223 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745229 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745235 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745241 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745246 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745251 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745255 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745260 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745265 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745270 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745274 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745278 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745282 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.749593 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745286 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745292 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745296 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745304 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745308 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745313 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745316 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745321 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745325 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745330 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745334 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745338 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745342 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745346 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745351 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745355 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745359 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745363 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745367 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.745372 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.750243 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746037 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746047 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746051 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746057 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746061 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746067 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746072 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746076 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746080 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746085 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746089 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746093 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746097 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746102 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746107 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746112 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746116 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746120 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746124 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746128 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.750761 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746132 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746137 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746141 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746145 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746149 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746154 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746158 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746163 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746167 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746174 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746180 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746186 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746191 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746196 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746200 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746205 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746210 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746214 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746218 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746222 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.751326 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746227 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746231 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746235 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746239 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746243 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746247 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746254 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746260 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746266 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746271 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746275 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746279 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746284 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746290 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746294 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746298 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746302 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746307 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746313 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.751848 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746318 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746322 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746327 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746331 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746338 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746343 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746348 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746352 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746356 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746360 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746365 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746369 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746373 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746377 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746381 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746385 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746390 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746394 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746398 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746402 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.752327 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746407 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746411 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746415 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746439 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746443 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746450 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746455 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746459 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746463 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746468 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746472 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746476 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746479 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746483 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746488 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746492 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746496 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746500 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746505 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.746509 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.752874 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746609 2556 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746619 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746629 2556 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746636 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746642 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746648 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746654 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746660 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746665 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746670 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746675 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746681 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746686 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746692 2556 flags.go:64] FLAG: --cgroup-root="" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746697 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746701 2556 flags.go:64] FLAG: --client-ca-file="" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746706 2556 flags.go:64] FLAG: --cloud-provider="external" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746713 2556 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746721 2556 flags.go:64] FLAG: --cluster-domain="" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746726 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746731 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746736 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746741 2556 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746747 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 22:47:37.753359 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746752 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746756 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746762 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746767 2556 flags.go:64] FLAG: --contention-profiling="false" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746772 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746776 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746781 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746786 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746793 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746797 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746820 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746826 2556 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746832 2556 flags.go:64] FLAG: --enable-server="true" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746837 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746845 2556 flags.go:64] FLAG: --event-burst="100" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746850 2556 flags.go:64] FLAG: --event-qps="50" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746855 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746860 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746865 2556 flags.go:64] FLAG: --eviction-hard="" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746873 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746882 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746887 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746893 2556 flags.go:64] FLAG: --eviction-soft="" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746898 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746903 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 22:47:37.754030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746909 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746913 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746918 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746923 2556 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746928 2556 flags.go:64] FLAG: --feature-gates="" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746934 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746939 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746944 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746949 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746953 2556 flags.go:64] FLAG: --healthz-port="10248" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746958 2556 flags.go:64] FLAG: --help="false" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746963 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-141-245.ec2.internal" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746968 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746973 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746978 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746984 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746989 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746994 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.746999 2556 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747003 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747008 2556 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747013 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747018 2556 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747023 2556 flags.go:64] FLAG: --kube-reserved="" Jun 08 22:47:37.754686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747028 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747032 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747037 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747043 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747048 2556 flags.go:64] FLAG: --lock-file="" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747052 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747058 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747063 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747073 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747078 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747083 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747088 2556 flags.go:64] FLAG: --logging-format="text" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747093 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747098 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747102 2556 flags.go:64] FLAG: --manifest-url="" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747107 2556 flags.go:64] FLAG: --manifest-url-header="" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747114 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747119 2556 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747125 2556 flags.go:64] FLAG: --max-pods="110" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747130 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747135 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747140 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747144 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747149 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747154 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 22:47:37.755268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747169 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747187 2556 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747193 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747197 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747202 2556 flags.go:64] FLAG: --pod-cidr="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747206 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747215 2556 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747220 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747225 2556 flags.go:64] FLAG: --pods-per-core="0" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747229 2556 flags.go:64] FLAG: --port="10250" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747236 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747241 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f671629682b25f1" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747246 2556 flags.go:64] FLAG: --qos-reserved="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747251 2556 flags.go:64] FLAG: --read-only-port="10255" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747258 2556 flags.go:64] FLAG: --register-node="true" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747263 2556 flags.go:64] FLAG: --register-with-taints="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747271 2556 flags.go:64] FLAG: --registry-burst="10" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747275 2556 flags.go:64] FLAG: --registry-qps="5" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747280 2556 flags.go:64] FLAG: --reserved-cpus="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747284 2556 flags.go:64] FLAG: --reserved-memory="" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747290 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747295 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747301 2556 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747305 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747310 2556 flags.go:64] FLAG: --runonce="false" Jun 08 22:47:37.755914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747315 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747320 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747325 2556 flags.go:64] FLAG: --seccomp-default="false" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747330 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747334 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747339 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747344 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747349 2556 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747354 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747358 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747363 2556 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747367 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747372 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747377 2556 flags.go:64] FLAG: --system-cgroups="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747392 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747401 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747405 2556 flags.go:64] FLAG: --tls-cert-file="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747411 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747433 2556 flags.go:64] FLAG: --tls-min-version="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747438 2556 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747443 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747447 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747453 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747460 2556 flags.go:64] FLAG: --v="2" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747477 2556 flags.go:64] FLAG: --version="false" Jun 08 22:47:37.756550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747484 2556 flags.go:64] FLAG: --vmodule="" Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747490 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.747496 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747679 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747686 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747691 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747695 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747700 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747704 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747709 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747713 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747717 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747722 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747726 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747730 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747734 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747738 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747741 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747745 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747750 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.757154 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747754 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747758 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747762 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747767 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747773 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747777 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747781 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747785 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747789 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747796 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747806 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747811 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747816 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747821 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747825 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747829 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747834 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747838 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747842 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747847 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.757753 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747851 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747855 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747859 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747864 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747868 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747872 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747876 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747880 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747885 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747891 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747898 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747903 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747907 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747913 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747919 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747925 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747931 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747936 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747940 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.758238 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747945 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747950 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747954 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747960 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747965 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747970 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747974 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747979 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747984 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747988 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747993 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.747997 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748002 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748008 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748013 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748017 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748021 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748025 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748029 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748034 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.758721 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748038 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748042 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748046 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748071 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748078 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748082 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748087 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748091 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748096 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748103 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748107 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748112 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748116 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748120 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748125 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748131 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748137 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748143 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748148 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.759206 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748152 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748156 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748160 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.748164 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.748832 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.755696 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.755716 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.755736 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.755745 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755803 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755808 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755810 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755813 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755816 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.759690 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755819 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755824 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755827 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755831 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755834 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755837 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755841 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755845 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755848 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755850 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755853 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755856 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755858 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755861 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755864 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755866 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755869 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755872 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755874 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.760056 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755877 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755880 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755882 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755885 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755887 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755896 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755899 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755902 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755905 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755908 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755910 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755913 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755916 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755919 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755922 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755924 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755927 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755930 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755933 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755935 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.760551 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755938 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755941 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755944 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755947 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755949 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755952 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755955 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755957 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755960 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755962 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755965 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755968 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755971 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755975 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755978 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755981 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755984 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755987 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755996 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.761028 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.755999 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756001 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756004 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756007 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756009 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756011 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756014 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756017 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756019 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756022 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756024 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756027 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756029 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756032 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756034 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756037 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756039 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756055 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756058 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756061 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.761604 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756064 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756067 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756070 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756073 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756076 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756078 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756081 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756084 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756087 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756089 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756092 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756095 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756103 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756106 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756108 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.762081 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756111 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.756116 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756274 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756279 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756282 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756285 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756287 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756290 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756292 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756296 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756300 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756303 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756305 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756308 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756311 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 22:47:37.762454 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756313 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756316 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756318 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756321 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756323 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756326 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756328 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756331 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756333 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756336 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756338 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756341 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756344 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756347 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756349 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756358 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756360 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756363 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756365 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756368 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 22:47:37.762858 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756370 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756373 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756375 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756378 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756380 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756383 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756387 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756390 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756393 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756396 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756398 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756401 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756404 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756407 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756410 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756413 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756416 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756435 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756439 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 22:47:37.763329 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756444 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756448 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756451 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756454 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756457 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756460 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756462 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756465 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756467 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756478 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756481 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756483 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756486 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756489 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756491 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756494 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756496 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756499 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756501 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 22:47:37.763817 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756504 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756506 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756509 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756511 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756514 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756516 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756518 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756521 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756523 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756526 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756529 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756531 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756534 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756536 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756539 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756541 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756544 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756547 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756550 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756552 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 22:47:37.764268 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756555 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756558 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756560 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756571 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756574 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756576 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756579 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:37.756582 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.756587 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.756704 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.758764 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.760323 2556 server.go:1019] "Starting client certificate rotation" Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.760437 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.760516 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 22:47:37.764771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.762995 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 22:47:37.765123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.764449 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 22:47:37.776828 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.776807 2556 log.go:25] "Validated CRI v1 runtime API" Jun 08 22:47:37.779789 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.779773 2556 log.go:25] "Validated CRI v1 image API" Jun 08 22:47:37.780676 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.780655 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 22:47:37.786077 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.786057 2556 fs.go:135] Filesystem UUIDs: map[0cf363c3-55d1-4fb1-9840-066c41bb15d4:/dev/nvme0n1p4 130efc46-fba8-4b32-b9e1-ee41c96e0dd8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 08 22:47:37.786147 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.786076 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 22:47:37.789050 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.789025 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 22:47:37.792242 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.792124 2556 manager.go:216] Machine: {Timestamp:2026-06-08 22:47:37.790699246 +0000 UTC m=+0.347529090 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122886 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2177a61b038dd6bb5bfcd38d3355fc SystemUUID:ec2177a6-1b03-8dd6-bb5b-fcd38d3355fc BootID:8501eedf-d61d-421e-873d-a76530c9e35d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:9b:8f:18:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:9b:8f:18:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:f2:39:50:e7:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 22:47:37.792242 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.792230 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 22:47:37.792399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.792328 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 22:47:37.794652 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.794630 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 22:47:37.794793 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.794655 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 22:47:37.795316 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.795307 2556 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 22:47:37.795352 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.795319 2556 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 22:47:37.795352 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.795326 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 22:47:37.796692 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.796681 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 22:47:37.797487 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.797477 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 22:47:37.800345 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800333 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 08 22:47:37.800491 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800481 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 22:47:37.800531 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800512 2556 kubelet.go:486] "Attempting to sync node with API server" Jun 08 22:47:37.800531 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800523 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 22:47:37.800622 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800546 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 22:47:37.800622 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800558 2556 kubelet.go:398] "Adding apiserver pod source" Jun 08 22:47:37.800622 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800612 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 22:47:37.800982 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.800970 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 22:47:37.801040 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.801026 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 22:47:37.803330 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.803303 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 22:47:37.805014 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.805001 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 22:47:37.805053 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.805031 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 22:47:37.806242 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806227 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 22:47:37.806296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806254 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 22:47:37.806296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806268 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 22:47:37.806296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806278 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 22:47:37.806296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806295 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806306 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806317 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806323 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806336 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806342 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806351 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806356 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806431 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 22:47:37.806502 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.806441 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 22:47:37.809750 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.809738 2556 server.go:1268] "Started kubelet" Jun 08 22:47:37.809935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.809907 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 22:47:37.809996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.809908 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 22:47:37.809996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.809975 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 22:47:37.810841 ip-10-0-141-245 systemd[1]: Started Kubernetes Kubelet. Jun 08 22:47:37.814523 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.814487 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 22:47:37.814737 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.814715 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 22:47:37.815055 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.815036 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 22:47:37.815203 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.815056 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 22:47:37.816470 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.816452 2556 server.go:310] "Adding debug handlers to kubelet server" Jun 08 22:47:37.817049 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.817021 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 22:47:37.819650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.819631 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 22:47:37.819650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.819647 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 22:47:37.819790 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.819765 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:37.820370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820327 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 22:47:37.820370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820330 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 22:47:37.820370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820372 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 22:47:37.820614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820404 2556 factory.go:55] Registering systemd factory Jun 08 22:47:37.820614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820437 2556 factory.go:223] Registration of the systemd container factory successfully Jun 08 22:47:37.820614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820532 2556 reconstruct.go:97] "Volume reconstruction finished" Jun 08 22:47:37.820614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820542 2556 reconciler.go:29] "Reconciler: start to sync state" Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.819550 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-245.ec2.internal.18b73ca52f5558f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-245.ec2.internal,UID:ip-10-0-141-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-245.ec2.internal,},FirstTimestamp:2026-06-08 22:47:37.809713398 +0000 UTC m=+0.366543229,LastTimestamp:2026-06-08 22:47:37.809713398 +0000 UTC m=+0.366543229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-245.ec2.internal,}" Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820666 2556 factory.go:153] Registering CRI-O factory Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820681 2556 factory.go:223] Registration of the crio container factory successfully Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820733 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820756 2556 factory.go:103] Registering Raw factory Jun 08 22:47:37.820790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.820772 2556 manager.go:1196] Started watching for new ooms in manager Jun 08 22:47:37.821482 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.821466 2556 manager.go:349] Starting recovery of all containers Jun 08 22:47:37.831042 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.830863 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rbf42" Jun 08 22:47:37.831997 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.831964 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 22:47:37.831997 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.831972 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 22:47:37.833166 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.833153 2556 manager.go:354] Recovery completed Jun 08 22:47:37.837175 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.837163 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.837563 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.837526 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rbf42" Jun 08 22:47:37.839017 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839003 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.839075 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839029 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.839075 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839039 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.839635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839618 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 22:47:37.839635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839629 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.839635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839635 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 22:47:37.839790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.839653 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 08 22:47:37.840531 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.840517 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.840598 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.840542 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.840598 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.840551 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.840714 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.840701 2556 policy_none.go:49] "None policy: Start" Jun 08 22:47:37.841192 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.841178 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 22:47:37.841225 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.841208 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 22:47:37.842253 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.842239 2556 policy_none.go:47] "Start" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.883815 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.883847 2556 manager.go:337] "Starting Device Plugin manager" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.883875 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.883890 2556 server.go:87] "Starting device plugin registration server" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.884142 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.884152 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.884273 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.884354 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.884364 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.885019 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.885070 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.885195 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.885225 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.885242 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.885271 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 22:47:37.894303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.887463 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 22:47:37.984491 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.984466 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.985348 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985333 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.985405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985362 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.985405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985375 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.985405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985397 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-245.ec2.internal" Jun 08 22:47:37.985510 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985322 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal"] Jun 08 22:47:37.985510 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.985484 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.986192 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.986178 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.986259 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.986207 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.986259 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.986223 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.988572 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.988559 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.988698 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.988683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:37.988734 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.988717 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.989222 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989207 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.989277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989220 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.989277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989235 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.989277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989242 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.989277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989245 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.989277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.989253 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.991559 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.991544 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:37.991612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.991572 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 22:47:37.992289 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.992273 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" Jun 08 22:47:37.992352 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.992300 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 22:47:37.992352 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.992310 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" Jun 08 22:47:37.993959 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:37.993944 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-245.ec2.internal" Jun 08 22:47:37.994035 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:37.993963 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-245.ec2.internal\": node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.008972 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.008955 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-245.ec2.internal\" not found" node="ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.013399 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.013381 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-245.ec2.internal\" not found" node="ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.013660 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.013646 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.021769 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.021753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.021837 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.021776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/180adb5a001eed42bf585f00ceb86a9d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"180adb5a001eed42bf585f00ceb86a9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.021837 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.021793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.114515 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.114495 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.122842 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/180adb5a001eed42bf585f00ceb86a9d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"180adb5a001eed42bf585f00ceb86a9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.122887 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.122887 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.122947 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122917 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.122947 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122922 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/180adb5a001eed42bf585f00ceb86a9d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"180adb5a001eed42bf585f00ceb86a9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.123011 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.122957 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd3ad9b8b6805f24cc50c1bb943726c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"1fd3ad9b8b6805f24cc50c1bb943726c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.215015 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.214991 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.315876 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.315807 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.315876 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.315817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.320629 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.320382 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:38.416915 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.416885 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.517459 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.517428 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.617948 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.617892 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.718463 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.718434 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.759863 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.759831 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 22:47:38.760312 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.759964 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 22:47:38.818921 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.818892 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.839744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.839706 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 22:42:37 +0000 UTC" deadline="2028-03-19 15:02:15.774810896 +0000 UTC" Jun 08 22:47:38.839744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.839737 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15592h14m36.935077102s" Jun 08 22:47:38.904464 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:38.904415 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180adb5a001eed42bf585f00ceb86a9d.slice/crio-5ff9a5a1acd19ec457f63918ecec8626510ab9a3c8fa9b027b1a24f29c112944 WatchSource:0}: Error finding container 5ff9a5a1acd19ec457f63918ecec8626510ab9a3c8fa9b027b1a24f29c112944: Status 404 returned error can't find the container with id 5ff9a5a1acd19ec457f63918ecec8626510ab9a3c8fa9b027b1a24f29c112944 Jun 08 22:47:38.904796 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:38.904774 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd3ad9b8b6805f24cc50c1bb943726c.slice/crio-51938dc7036d28b05164af61a0c63c6e3c95d1be556b4e73c2323e3fd17c8baa WatchSource:0}: Error finding container 51938dc7036d28b05164af61a0c63c6e3c95d1be556b4e73c2323e3fd17c8baa: Status 404 returned error can't find the container with id 51938dc7036d28b05164af61a0c63c6e3c95d1be556b4e73c2323e3fd17c8baa Jun 08 22:47:38.911127 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.911113 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:47:38.919770 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:38.919754 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" Jun 08 22:47:38.982757 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:38.982725 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 22:47:39.001205 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.001179 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 22:47:39.020259 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.020232 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" Jun 08 22:47:39.029783 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.029762 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 22:47:39.032127 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.032112 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" Jun 08 22:47:39.042514 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.042498 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 22:47:39.163522 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.163439 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 22:47:39.802258 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.802219 2556 apiserver.go:52] "Watching apiserver" Jun 08 22:47:39.815291 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.815263 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 22:47:39.815657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.815627 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7lsgw","openshift-multus/network-metrics-daemon-q49tl","openshift-network-operator/iptables-alerter-l8vjq","kube-system/global-pull-secret-syncer-rw2sg","kube-system/konnectivity-agent-bxqfp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8","openshift-cluster-node-tuning-operator/tuned-bj7zr","openshift-dns/node-resolver-splbb","openshift-multus/multus-additional-cni-plugins-slh84","openshift-network-diagnostics/network-check-target-xswr7","openshift-ovn-kubernetes/ovnkube-node-bfp78","kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal","openshift-image-registry/node-ca-ddz4r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal"] Jun 08 22:47:39.818109 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.818085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.820277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.820257 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 22:47:39.820376 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.820331 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.820911 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.820891 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.820998 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.820961 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.820998 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.820974 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8cnvg\"" Jun 08 22:47:39.822595 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.822443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.823346 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.823328 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.823489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.823372 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62gb9\"" Jun 08 22:47:39.823599 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.823570 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 22:47:39.823664 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.823571 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.824965 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.824947 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.825052 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.824975 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ccx2\"" Jun 08 22:47:39.825052 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.825038 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.825210 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.825196 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:39.825286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.825271 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 22:47:39.825373 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:39.825264 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:39.828344 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.827206 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:39.829327 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.829307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.830188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.829918 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 22:47:39.830188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.829919 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkkls\"" Jun 08 22:47:39.830188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.829938 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 22:47:39.830188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.830018 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 22:47:39.831607 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysconfig\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831587 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 22:47:39.831689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-sys\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-var-lib-kubelet\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831686 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-tuned\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsb7\" (UniqueName: \"kubernetes.io/projected/cce45e48-1f41-4989-8e72-1cfe5e077604-kube-api-access-rdsb7\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-modprobe-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-run\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e1b96d2-ad5d-409b-9453-f23956fe864b-serviceca\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4243bbc3-3545-4289-9850-48db4136053a-host-slash\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsntx\" (UniqueName: \"kubernetes.io/projected/4243bbc3-3545-4289-9850-48db4136053a-kube-api-access-hsntx\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-kubernetes\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831856 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831873 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-conf\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-host\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831918 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-tmp\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-systemd\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.831962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-lib-modules\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.832582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831974 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wftb4\"" Jun 08 22:47:39.832582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.831983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e1b96d2-ad5d-409b-9453-f23956fe864b-host\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.832582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.832014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mglp2\" (UniqueName: \"kubernetes.io/projected/2e1b96d2-ad5d-409b-9453-f23956fe864b-kube-api-access-mglp2\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.832582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.832037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4243bbc3-3545-4289-9850-48db4136053a-iptables-alerter-script\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.832582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.832050 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.834269 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834252 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.834714 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834691 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.834804 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834743 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 22:47:39.834862 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834847 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nmb2j\"" Jun 08 22:47:39.834916 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.834962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 22:47:39.835012 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.834746 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 22:47:39.836612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.836595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:39.836702 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:39.836664 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:39.836907 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.836888 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r6xx4\"" Jun 08 22:47:39.836994 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.836978 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 22:47:39.838714 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.838695 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:39.838803 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:39.838765 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:39.841843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.841259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.843672 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.843653 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:39.845416 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.845125 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 22:47:39.845575 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.845557 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 22:47:39.846072 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.846054 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.846846 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.846388 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 22:47:39.846988 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.846870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bvtwd\"" Jun 08 22:47:39.847285 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.847261 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 22:47:39.847764 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.847744 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.849702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.847936 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2s8nc\"" Jun 08 22:47:39.849702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.847965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 22:47:39.849702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.848445 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 22:47:39.849702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.848762 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnbd7" Jun 08 22:47:39.854325 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.854304 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnbd7" Jun 08 22:47:39.890208 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.890155 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" event={"ID":"180adb5a001eed42bf585f00ceb86a9d","Type":"ContainerStarted","Data":"5ff9a5a1acd19ec457f63918ecec8626510ab9a3c8fa9b027b1a24f29c112944"} Jun 08 22:47:39.891696 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.891669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"1fd3ad9b8b6805f24cc50c1bb943726c","Type":"ContainerStarted","Data":"51938dc7036d28b05164af61a0c63c6e3c95d1be556b4e73c2323e3fd17c8baa"} Jun 08 22:47:39.921893 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.921870 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 22:47:39.932891 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-script-lib\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.932891 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-device-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4243bbc3-3545-4289-9850-48db4136053a-iptables-alerter-script\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-systemd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-log-socket\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.932987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx94t\" (UniqueName: \"kubernetes.io/projected/ff06e628-ccf1-419e-a895-55905b0658c5-kube-api-access-kx94t\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-socket-dir-parent\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-conf-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933078 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933054 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2h9l\" (UniqueName: \"kubernetes.io/projected/7bc1b881-ce47-4346-9b41-241fb4c053b1-kube-api-access-f2h9l\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-netns\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-bin\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-os-release\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef23a427-e719-4c05-bc76-fa0efd5c8f17-hosts-file\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-modprobe-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e1b96d2-ad5d-409b-9453-f23956fe864b-serviceca\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-slash\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-netd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933438 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4243bbc3-3545-4289-9850-48db4136053a-iptables-alerter-script\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9frxt\" (UniqueName: \"kubernetes.io/projected/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-kube-api-access-9frxt\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfn8c\" (UniqueName: \"kubernetes.io/projected/ef23a427-e719-4c05-bc76-fa0efd5c8f17-kube-api-access-cfn8c\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933506 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-modprobe-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-system-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-kubernetes\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933638 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-netns\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933680 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-kubernetes\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e1b96d2-ad5d-409b-9453-f23956fe864b-host\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-cni-binary-copy\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933732 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e1b96d2-ad5d-409b-9453-f23956fe864b-host\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933758 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-bin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.933940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-var-lib-kubelet\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4243bbc3-3545-4289-9850-48db4136053a-host-slash\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933843 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e1b96d2-ad5d-409b-9453-f23956fe864b-serviceca\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933864 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-var-lib-kubelet\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovn-node-metrics-cert\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4243bbc3-3545-4289-9850-48db4136053a-host-slash\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.933989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rgn\" (UniqueName: \"kubernetes.io/projected/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-kube-api-access-w7rgn\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsntx\" (UniqueName: \"kubernetes.io/projected/4243bbc3-3545-4289-9850-48db4136053a-kube-api-access-hsntx\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-kubelet-config\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-multus-certs\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-config\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-lib-modules\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mglp2\" (UniqueName: \"kubernetes.io/projected/2e1b96d2-ad5d-409b-9453-f23956fe864b-kube-api-access-mglp2\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-multus\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.934762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934446 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-lib-modules\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysconfig\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934534 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-tuned\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-kubelet\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934585 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-systemd-units\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934608 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-env-overrides\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysconfig\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef23a427-e719-4c05-bc76-fa0efd5c8f17-tmp-dir\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934659 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-d\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-dbus\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f92167ab-11f7-4873-abb5-3b13cbf7d73a-agent-certs\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-system-cni-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-cnibin\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934849 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-hostroot\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934902 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 22:47:39.935631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.934914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-daemon-config\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-conf\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-host\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-ovn\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-systemd\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935169 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-host\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935214 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-systemd\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5sp8\" (UniqueName: \"kubernetes.io/projected/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kube-api-access-f5sp8\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-sysctl-conf\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-os-release\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-etc-kubernetes\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-sys\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsb7\" (UniqueName: \"kubernetes.io/projected/cce45e48-1f41-4989-8e72-1cfe5e077604-kube-api-access-rdsb7\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935478 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-sys\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.936444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-etc-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-node-log\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-cnibin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-run\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935783 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f92167ab-11f7-4873-abb5-3b13cbf7d73a-konnectivity-ca\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-k8s-cni-cncf-io\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935826 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cce45e48-1f41-4989-8e72-1cfe5e077604-run\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-kubelet\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-tmp\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-var-lib-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.937054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.935931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:39.938564 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.938540 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-etc-tuned\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.938675 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.938587 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce45e48-1f41-4989-8e72-1cfe5e077604-tmp\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:39.945599 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.945545 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsntx\" (UniqueName: \"kubernetes.io/projected/4243bbc3-3545-4289-9850-48db4136053a-kube-api-access-hsntx\") pod \"iptables-alerter-l8vjq\" (UID: \"4243bbc3-3545-4289-9850-48db4136053a\") " pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:39.945787 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.945766 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mglp2\" (UniqueName: \"kubernetes.io/projected/2e1b96d2-ad5d-409b-9453-f23956fe864b-kube-api-access-mglp2\") pod \"node-ca-ddz4r\" (UID: \"2e1b96d2-ad5d-409b-9453-f23956fe864b\") " pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:39.946241 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:39.946197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsb7\" (UniqueName: \"kubernetes.io/projected/cce45e48-1f41-4989-8e72-1cfe5e077604-kube-api-access-rdsb7\") pod \"tuned-bj7zr\" (UID: \"cce45e48-1f41-4989-8e72-1cfe5e077604\") " pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:40.036209 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-cni-binary-copy\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-bin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036254 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovn-node-metrics-cert\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rgn\" (UniqueName: \"kubernetes.io/projected/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-kube-api-access-w7rgn\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-kubelet-config\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-multus-certs\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-config\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036365 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-bin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036388 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-kubelet-config\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-multus\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-kubelet\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-systemd-units\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036576 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-env-overrides\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef23a427-e719-4c05-bc76-fa0efd5c8f17-tmp-dir\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036651 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-dbus\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f92167ab-11f7-4873-abb5-3b13cbf7d73a-agent-certs\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-system-cni-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-cnibin\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-hostroot\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.036935 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-daemon-config\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-ovn\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036858 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-dbus\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036884 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-cni-binary-copy\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5sp8\" (UniqueName: \"kubernetes.io/projected/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kube-api-access-f5sp8\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-os-release\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-etc-kubernetes\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-etc-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037041 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-node-log\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-env-overrides\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-cnibin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f92167ab-11f7-4873-abb5-3b13cbf7d73a-konnectivity-ca\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037105 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-multus-certs\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-k8s-cni-cncf-io\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.037760 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037122 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef23a427-e719-4c05-bc76-fa0efd5c8f17-tmp-dir\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-kubelet\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-var-lib-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037154 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-cni-multus\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-os-release\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037201 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-kubelet\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-script-lib\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037204 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-etc-kubernetes\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-device-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037269 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-hostroot\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-systemd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037294 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-system-cni-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-log-socket\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-ovn\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx94t\" (UniqueName: \"kubernetes.io/projected/ff06e628-ccf1-419e-a895-55905b0658c5-kube-api-access-kx94t\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.038654 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-socket-dir-parent\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037376 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-systemd-units\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037470 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-cnibin\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.036957 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037773 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-run-systemd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037818 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-device-dir\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037345 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-log-socket\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-daemon-config\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037917 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-config\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-socket-dir-parent\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.037278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-etc-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038009 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-var-lib-kubelet\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038028 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-var-lib-openvswitch\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038043 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-node-log\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.039483 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038051 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-k8s-cni-cncf-io\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-conf-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-cnibin\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038086 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f92167ab-11f7-4873-abb5-3b13cbf7d73a-konnectivity-ca\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h9l\" (UniqueName: \"kubernetes.io/projected/7bc1b881-ce47-4346-9b41-241fb4c053b1-kube-api-access-f2h9l\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038119 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-multus-conf-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-netns\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-bin\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.038201 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-os-release\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.038288 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:47:40.538254927 +0000 UTC m=+3.095084761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef23a427-e719-4c05-bc76-fa0efd5c8f17-hosts-file\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-slash\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-netd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040282 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9frxt\" (UniqueName: \"kubernetes.io/projected/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-kube-api-access-9frxt\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-bin\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfn8c\" (UniqueName: \"kubernetes.io/projected/ef23a427-e719-4c05-bc76-fa0efd5c8f17-kube-api-access-cfn8c\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038498 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovnkube-script-lib\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-system-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038512 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-slash\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff06e628-ccf1-419e-a895-55905b0658c5-os-release\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-netns\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-host-run-netns\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038673 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038482 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-run-netns\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-host-cni-netd\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef23a427-e719-4c05-bc76-fa0efd5c8f17-hosts-file\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038762 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.040996 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.038839 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.038912 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:40.538896139 +0000 UTC m=+3.095725973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.038921 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc1b881-ce47-4346-9b41-241fb4c053b1-system-cni-dir\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.039107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.039211 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff06e628-ccf1-419e-a895-55905b0658c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.039775 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-ovn-node-metrics-cert\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.041613 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.040480 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f92167ab-11f7-4873-abb5-3b13cbf7d73a-agent-certs\") pod \"konnectivity-agent-bxqfp\" (UID: \"f92167ab-11f7-4873-abb5-3b13cbf7d73a\") " pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:40.045780 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.045759 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:40.045780 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.045783 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:40.045952 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.045798 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:40.045952 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.045855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:40.545841207 +0000 UTC m=+3.102671061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:40.048616 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.048562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rgn\" (UniqueName: \"kubernetes.io/projected/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-kube-api-access-w7rgn\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:40.048730 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.048620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h9l\" (UniqueName: \"kubernetes.io/projected/7bc1b881-ce47-4346-9b41-241fb4c053b1-kube-api-access-f2h9l\") pod \"multus-7lsgw\" (UID: \"7bc1b881-ce47-4346-9b41-241fb4c053b1\") " pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.049296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.049249 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfn8c\" (UniqueName: \"kubernetes.io/projected/ef23a427-e719-4c05-bc76-fa0efd5c8f17-kube-api-access-cfn8c\") pod \"node-resolver-splbb\" (UID: \"ef23a427-e719-4c05-bc76-fa0efd5c8f17\") " pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.049664 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.049639 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx94t\" (UniqueName: \"kubernetes.io/projected/ff06e628-ccf1-419e-a895-55905b0658c5-kube-api-access-kx94t\") pod \"multus-additional-cni-plugins-slh84\" (UID: \"ff06e628-ccf1-419e-a895-55905b0658c5\") " pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.050115 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.050092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9frxt\" (UniqueName: \"kubernetes.io/projected/7dbafa25-af8a-4c11-bd2d-a09e45d5ec29-kube-api-access-9frxt\") pod \"ovnkube-node-bfp78\" (UID: \"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.050195 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.050148 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5sp8\" (UniqueName: \"kubernetes.io/projected/6180d0bb-0bb0-4875-9213-4a0c637b9eeb-kube-api-access-f5sp8\") pod \"aws-ebs-csi-driver-node-4jqp8\" (UID: \"6180d0bb-0bb0-4875-9213-4a0c637b9eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.131041 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.130959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" Jun 08 22:47:40.139704 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.139682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddz4r" Jun 08 22:47:40.150656 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.150635 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-slh84" Jun 08 22:47:40.156511 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.156487 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8vjq" Jun 08 22:47:40.156951 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.156932 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 22:47:40.165180 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.165161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:47:40.172799 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.172780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" Jun 08 22:47:40.179475 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.179455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7lsgw" Jun 08 22:47:40.189195 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.189177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:47:40.193877 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.193855 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-splbb" Jun 08 22:47:40.542373 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.542341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:40.542549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.542386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:40.542549 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.542509 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:40.542630 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.542576 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:47:41.542557304 +0000 UTC m=+4.099387127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:40.542630 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.542509 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:40.542709 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.542640 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:41.542628417 +0000 UTC m=+4.099458235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:40.643074 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.643038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:40.643246 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.643219 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:40.643246 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.643246 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:40.643382 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.643256 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:40.643382 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:40.643313 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:41.643297758 +0000 UTC m=+4.200127578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:40.857217 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.857127 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 22:42:39 +0000 UTC" deadline="2028-01-19 15:27:56.657709991 +0000 UTC" Jun 08 22:47:40.857217 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:40.857160 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14152h40m15.800553644s" Jun 08 22:47:40.919621 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.919577 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce45e48_1f41_4989_8e72_1cfe5e077604.slice/crio-ee2d44a8d55f45531677f027f3ecc89384396de8f06797f26fbea32117c3267e WatchSource:0}: Error finding container ee2d44a8d55f45531677f027f3ecc89384396de8f06797f26fbea32117c3267e: Status 404 returned error can't find the container with id ee2d44a8d55f45531677f027f3ecc89384396de8f06797f26fbea32117c3267e Jun 08 22:47:40.920857 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.920827 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef23a427_e719_4c05_bc76_fa0efd5c8f17.slice/crio-cc5511095ce80250c03f57d65a5204a69b1fbba9ccb0bb735597383b3b9cddad WatchSource:0}: Error finding container cc5511095ce80250c03f57d65a5204a69b1fbba9ccb0bb735597383b3b9cddad: Status 404 returned error can't find the container with id cc5511095ce80250c03f57d65a5204a69b1fbba9ccb0bb735597383b3b9cddad Jun 08 22:47:40.921578 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.921504 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4243bbc3_3545_4289_9850_48db4136053a.slice/crio-0d3a23bf2081aaf02d7c4a0d285b5c7455b5441681fb63441f5aae5d60c71b2f WatchSource:0}: Error finding container 0d3a23bf2081aaf02d7c4a0d285b5c7455b5441681fb63441f5aae5d60c71b2f: Status 404 returned error can't find the container with id 0d3a23bf2081aaf02d7c4a0d285b5c7455b5441681fb63441f5aae5d60c71b2f Jun 08 22:47:40.948451 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.948407 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1b96d2_ad5d_409b_9453_f23956fe864b.slice/crio-e2a7a8401a439781142200a9ab056d217e6fe13934e9d9350d3b95a8b55a6a5d WatchSource:0}: Error finding container e2a7a8401a439781142200a9ab056d217e6fe13934e9d9350d3b95a8b55a6a5d: Status 404 returned error can't find the container with id e2a7a8401a439781142200a9ab056d217e6fe13934e9d9350d3b95a8b55a6a5d Jun 08 22:47:40.950015 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.949980 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6180d0bb_0bb0_4875_9213_4a0c637b9eeb.slice/crio-a923ff4e52294581bf8f36999e5136e88455d0996ea25ba258205aa4f52125e3 WatchSource:0}: Error finding container a923ff4e52294581bf8f36999e5136e88455d0996ea25ba258205aa4f52125e3: Status 404 returned error can't find the container with id a923ff4e52294581bf8f36999e5136e88455d0996ea25ba258205aa4f52125e3 Jun 08 22:47:40.951989 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.951906 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff06e628_ccf1_419e_a895_55905b0658c5.slice/crio-dfec9903b23885296fccd626ec6445571df924f61ba0c9f5e9e5de9d8d48c470 WatchSource:0}: Error finding container dfec9903b23885296fccd626ec6445571df924f61ba0c9f5e9e5de9d8d48c470: Status 404 returned error can't find the container with id dfec9903b23885296fccd626ec6445571df924f61ba0c9f5e9e5de9d8d48c470 Jun 08 22:47:40.953145 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.953129 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbafa25_af8a_4c11_bd2d_a09e45d5ec29.slice/crio-6546e62fcbda6c40f0c013ddb60d7d846f1d20ae955f8466378f7f43e30d139f WatchSource:0}: Error finding container 6546e62fcbda6c40f0c013ddb60d7d846f1d20ae955f8466378f7f43e30d139f: Status 404 returned error can't find the container with id 6546e62fcbda6c40f0c013ddb60d7d846f1d20ae955f8466378f7f43e30d139f Jun 08 22:47:40.954671 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:47:40.954632 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc1b881_ce47_4346_9b41_241fb4c053b1.slice/crio-e7a3e94c606ddaad6aff7d8afeb82151edf10fb74e1931d33f56d1759ad1fe67 WatchSource:0}: Error finding container e7a3e94c606ddaad6aff7d8afeb82151edf10fb74e1931d33f56d1759ad1fe67: Status 404 returned error can't find the container with id e7a3e94c606ddaad6aff7d8afeb82151edf10fb74e1931d33f56d1759ad1fe67 Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.550065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.550117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.550244 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.550309 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:43.550289917 +0000 UTC m=+6.107119741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.550520 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:41.550604 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.550566 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:47:43.55055293 +0000 UTC m=+6.107382763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:41.651296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.650667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:41.651296 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.650840 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:41.651296 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.650864 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:41.651296 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.650877 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:41.651296 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.650937 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:43.650919735 +0000 UTC m=+6.207749559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:41.858217 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.858100 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 22:42:39 +0000 UTC" deadline="2028-01-10 05:55:50.957785765 +0000 UTC" Jun 08 22:47:41.858217 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.858164 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13927h8m9.099625139s" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.886281 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.886313 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.886402 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.886851 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.886914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:41.887036 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:41.886999 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:41.910630 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.910597 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7lsgw" event={"ID":"7bc1b881-ce47-4346-9b41-241fb4c053b1","Type":"ContainerStarted","Data":"e7a3e94c606ddaad6aff7d8afeb82151edf10fb74e1931d33f56d1759ad1fe67"} Jun 08 22:47:41.936945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.936908 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerStarted","Data":"dfec9903b23885296fccd626ec6445571df924f61ba0c9f5e9e5de9d8d48c470"} Jun 08 22:47:41.943191 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.943160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" event={"ID":"6180d0bb-0bb0-4875-9213-4a0c637b9eeb","Type":"ContainerStarted","Data":"a923ff4e52294581bf8f36999e5136e88455d0996ea25ba258205aa4f52125e3"} Jun 08 22:47:41.953358 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.953251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddz4r" event={"ID":"2e1b96d2-ad5d-409b-9453-f23956fe864b","Type":"ContainerStarted","Data":"e2a7a8401a439781142200a9ab056d217e6fe13934e9d9350d3b95a8b55a6a5d"} Jun 08 22:47:41.962689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.961811 2556 generic.go:356] "Generic (PLEG): container finished" podID="1fd3ad9b8b6805f24cc50c1bb943726c" containerID="0d2a66303d69289751367324614917134410c0cdf5f2ca75575dd4cbf38c90d4" exitCode=0 Jun 08 22:47:41.962689 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.961899 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"1fd3ad9b8b6805f24cc50c1bb943726c","Type":"ContainerDied","Data":"0d2a66303d69289751367324614917134410c0cdf5f2ca75575dd4cbf38c90d4"} Jun 08 22:47:41.968265 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.967825 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" event={"ID":"180adb5a001eed42bf585f00ceb86a9d","Type":"ContainerStarted","Data":"49b7426d6837a310914346dd22669ec4e13811529f6dbc8309a09fab4e25c5d1"} Jun 08 22:47:41.971277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.971164 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"6546e62fcbda6c40f0c013ddb60d7d846f1d20ae955f8466378f7f43e30d139f"} Jun 08 22:47:41.979834 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.979807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8vjq" event={"ID":"4243bbc3-3545-4289-9850-48db4136053a","Type":"ContainerStarted","Data":"0d3a23bf2081aaf02d7c4a0d285b5c7455b5441681fb63441f5aae5d60c71b2f"} Jun 08 22:47:41.989144 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.989114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-splbb" event={"ID":"ef23a427-e719-4c05-bc76-fa0efd5c8f17","Type":"ContainerStarted","Data":"cc5511095ce80250c03f57d65a5204a69b1fbba9ccb0bb735597383b3b9cddad"} Jun 08 22:47:41.994271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:41.994082 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" podStartSLOduration=2.994064007 podStartE2EDuration="2.994064007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:47:41.993333336 +0000 UTC m=+4.550163177" watchObservedRunningTime="2026-06-08 22:47:41.994064007 +0000 UTC m=+4.550893851" Jun 08 22:47:42.006343 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:42.006315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" event={"ID":"cce45e48-1f41-4989-8e72-1cfe5e077604","Type":"ContainerStarted","Data":"ee2d44a8d55f45531677f027f3ecc89384396de8f06797f26fbea32117c3267e"} Jun 08 22:47:42.017616 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:42.017587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxqfp" event={"ID":"f92167ab-11f7-4873-abb5-3b13cbf7d73a","Type":"ContainerStarted","Data":"af38fbd2222cdc62ab48ab864a33bdcb60f775c360a0528910ea5f5ddb64c0a3"} Jun 08 22:47:43.044588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.044553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"1fd3ad9b8b6805f24cc50c1bb943726c","Type":"ContainerStarted","Data":"db51f5faf7dd091035f65e3f9b4579f4c3395304c750d078298e491718003039"} Jun 08 22:47:43.565268 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.565230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:43.565464 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.565291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:43.565464 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.565359 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:43.565464 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.565431 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:43.565464 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.565450 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:47:47.565415965 +0000 UTC m=+10.122245788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:43.565691 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.565486 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:47.565467455 +0000 UTC m=+10.122297293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:43.665873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.665834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:43.666068 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.666053 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:43.666127 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.666076 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:43.666127 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.666090 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:43.666224 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.666146 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:47.666129141 +0000 UTC m=+10.222958973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.885635 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.885644 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:43.885775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.885780 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.885857 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:43.886226 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:43.885974 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:45.885815 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:45.885781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:45.886293 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:45.885782 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:45.886293 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:45.885937 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:45.886293 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:45.885986 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:45.886293 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:45.886029 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:45.886293 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:45.886112 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:47.597617 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.597581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:47.598057 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.597634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:47.598057 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.597823 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:47.598057 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.597894 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:47.598057 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.597899 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:55.597877218 +0000 UTC m=+18.154707057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:47.598057 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.597968 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:47:55.597949421 +0000 UTC m=+18.154779244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:47.698438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.698388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:47.698605 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.698577 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:47.698605 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.698602 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:47.698717 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.698616 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:47.698717 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.698676 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:47:55.698658121 +0000 UTC m=+18.255487956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:47.887041 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.886960 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:47.887196 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.887080 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:47.887196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.887108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:47.887307 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.887214 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:47.887307 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:47.887265 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:47.887433 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:47.887386 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:49.885823 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:49.885782 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:49.886364 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:49.885925 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:49.886364 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:49.886329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:49.886518 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:49.886494 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:49.886586 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:49.886502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:49.886638 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:49.886620 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:51.886358 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:51.886323 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:51.886358 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:51.886359 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:51.886878 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:51.886323 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:51.886878 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:51.886470 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:51.886878 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:51.886599 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:51.886878 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:51.886687 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:53.886490 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:53.886431 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:53.886963 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:53.886432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:53.886963 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:53.886557 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:53.886963 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:53.886577 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:53.886963 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:53.886692 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:53.886963 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:53.886828 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:55.660097 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.660063 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:55.660534 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.660104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:55.660534 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.660206 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:55.660534 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.660217 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:55.660534 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.660267 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:11.660251051 +0000 UTC m=+34.217080871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:47:55.660534 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.660281 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:48:11.660274119 +0000 UTC m=+34.217103936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:47:55.761181 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.761103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:55.761327 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.761273 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:47:55.761327 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.761301 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:47:55.761327 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.761310 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:55.761464 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.761366 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:11.761347128 +0000 UTC m=+34.318176972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:47:55.886083 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.886042 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:55.886083 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.886080 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:55.886327 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:55.886048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:55.886327 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.886189 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:55.886453 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.886338 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:55.886453 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:55.886412 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:57.886214 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:57.886186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:57.886739 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:57.886337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:57.886739 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:57.886346 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:57.886739 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:57.886498 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:57.886739 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:57.886532 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:57.886739 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:57.886627 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:47:59.885796 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:59.885507 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:47:59.886635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:59.885514 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:47:59.886635 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:59.885893 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:47:59.886635 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:59.885955 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:47:59.886635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:47:59.885595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:47:59.886635 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:47:59.886108 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:00.081372 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.081339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxqfp" event={"ID":"f92167ab-11f7-4873-abb5-3b13cbf7d73a","Type":"ContainerStarted","Data":"8cb8ca83372e5157b480268f1c94b37554345281f91503c6431287be21e6d79f"} Jun 08 22:48:00.082926 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.082897 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7lsgw" event={"ID":"7bc1b881-ce47-4346-9b41-241fb4c053b1","Type":"ContainerStarted","Data":"b9ec6ab0fc199ed94f0ebf59cd140e321057fddb30dc98d5cbfb30bf13fe4004"} Jun 08 22:48:00.084649 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.084621 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="41a37fdefaa4948a85461882945f3144c7843be56a3afded795a840beb5c3f81" exitCode=0 Jun 08 22:48:00.084762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.084711 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"41a37fdefaa4948a85461882945f3144c7843be56a3afded795a840beb5c3f81"} Jun 08 22:48:00.086321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.086300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" event={"ID":"6180d0bb-0bb0-4875-9213-4a0c637b9eeb","Type":"ContainerStarted","Data":"cf94b2f36de9b8061e0738acc9f6716d131cdf0c027543a6e56f2a298e12f4bb"} Jun 08 22:48:00.087861 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.087834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddz4r" event={"ID":"2e1b96d2-ad5d-409b-9453-f23956fe864b","Type":"ContainerStarted","Data":"d87ca57a638d07d2e7c6892493105078031bf0e414292a7a1796c04c8456a6cb"} Jun 08 22:48:00.091364 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"94a3dd2312e9c2ea8fc8c631e71de18968df5fdfd70e8940bbe7eedab0c31032"} Jun 08 22:48:00.091467 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"c30a83e8e96fc5ec86922b4212b9624d2d3d37ce242fd66b41d4481251f95acf"} Jun 08 22:48:00.091517 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091473 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"b67d297cac0ec22326e2a00db2c67d4ecae17715e4a607166cbd12533f8e4628"} Jun 08 22:48:00.091562 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"0f4754b19dd5835e59d34186fa516a9f09c0a5e4a009ab5a736ad5f9321f54ab"} Jun 08 22:48:00.091610 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"687f9ebc2f1bad2377e179fb7d7c58a0d5ecda043ae76d57fc64e1becaf1ca5f"} Jun 08 22:48:00.091610 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.091603 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"1dacb2d65d6e34360d403ba0b6dd24b5573389fc7fddd8cd05bd9b72111625c0"} Jun 08 22:48:00.092710 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.092672 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-splbb" event={"ID":"ef23a427-e719-4c05-bc76-fa0efd5c8f17","Type":"ContainerStarted","Data":"3658059dc12f855242bf25864b8caaf8f66e7d3b22e9c8adce67dfc799f75218"} Jun 08 22:48:00.094060 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.094039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" event={"ID":"cce45e48-1f41-4989-8e72-1cfe5e077604","Type":"ContainerStarted","Data":"7fab48f883f732186fd241a46b857a45c2634d63aa7b926e43b0ca93af4588ff"} Jun 08 22:48:00.096129 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.096095 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" podStartSLOduration=21.096065668 podStartE2EDuration="21.096065668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:47:43.058768699 +0000 UTC m=+5.615598539" watchObservedRunningTime="2026-06-08 22:48:00.096065668 +0000 UTC m=+22.652895499" Jun 08 22:48:00.096406 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.096387 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bxqfp" podStartSLOduration=7.562986798 podStartE2EDuration="22.096379868s" totalImagesPullingTime="14.53339307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:00.096194403 +0000 UTC m=+22.653024256" watchObservedRunningTime="2026-06-08 22:48:00.096379868 +0000 UTC m=+22.653209708" Jun 08 22:48:00.110255 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.110209 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-splbb" podStartSLOduration=3.5224666879999997 podStartE2EDuration="22.11019443s" totalImagesPullingTime="18.587727742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:00.110026101 +0000 UTC m=+22.666855942" watchObservedRunningTime="2026-06-08 22:48:00.11019443 +0000 UTC m=+22.667024269" Jun 08 22:48:00.125339 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.125297 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bj7zr" podStartSLOduration=3.534975936 podStartE2EDuration="22.125278952s" totalImagesPullingTime="18.590303016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:00.12468808 +0000 UTC m=+22.681517917" watchObservedRunningTime="2026-06-08 22:48:00.125278952 +0000 UTC m=+22.682108792" Jun 08 22:48:00.138160 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.138103 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ddz4r" podStartSLOduration=3.555548517 podStartE2EDuration="22.138090327s" totalImagesPullingTime="18.58254181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:00.137473371 +0000 UTC m=+22.694303213" watchObservedRunningTime="2026-06-08 22:48:00.138090327 +0000 UTC m=+22.694920170" Jun 08 22:48:00.188835 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.188791 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7lsgw" podStartSLOduration=3.558330028 podStartE2EDuration="22.188775554s" totalImagesPullingTime="18.630445526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:00.188358782 +0000 UTC m=+22.745188622" watchObservedRunningTime="2026-06-08 22:48:00.188775554 +0000 UTC m=+22.745605394" Jun 08 22:48:00.580076 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.580054 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 22:48:00.897763 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.897663 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T22:48:00.580071484Z","UUID":"b1aa2fff-fe8a-4099-a0c0-90a9bfcf0606","Handler":null,"Name":"","Endpoint":""} Jun 08 22:48:00.899254 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.899226 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 22:48:00.899366 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:00.899268 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 22:48:01.099279 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:01.099195 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8vjq" event={"ID":"4243bbc3-3545-4289-9850-48db4136053a","Type":"ContainerStarted","Data":"440ce1f30651c5a7db934c8ffa16fa10f1b612231b7295f33b44738161fde5e1"} Jun 08 22:48:01.101642 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:01.101611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" event={"ID":"6180d0bb-0bb0-4875-9213-4a0c637b9eeb","Type":"ContainerStarted","Data":"2aa7c2b6859d645fbb92709c76789318a990256e38e94a3960bea6d53b28575e"} Jun 08 22:48:01.886015 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:01.885982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:01.886187 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:01.885982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:01.886187 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:01.886111 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:01.886187 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:01.885982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:01.886351 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:01.886198 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:01.886351 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:01.886284 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:02.106384 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:02.106355 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" event={"ID":"6180d0bb-0bb0-4875-9213-4a0c637b9eeb","Type":"ContainerStarted","Data":"362df2e3ed098459cc9c3fdbb83d65768b41cd8a437c9b7c72e3ec25b8bed920"} Jun 08 22:48:02.125718 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:02.125670 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l8vjq" podStartSLOduration=9.578700261 podStartE2EDuration="24.125650929s" totalImagesPullingTime="14.546950668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:01.113474764 +0000 UTC m=+23.670304599" watchObservedRunningTime="2026-06-08 22:48:02.125650929 +0000 UTC m=+24.682480768" Jun 08 22:48:02.125898 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:02.125862 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4jqp8" podStartSLOduration=4.004368353 podStartE2EDuration="24.125852463s" totalImagesPullingTime="20.12148411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:02.12507921 +0000 UTC m=+24.681909050" watchObservedRunningTime="2026-06-08 22:48:02.125852463 +0000 UTC m=+24.682682366" Jun 08 22:48:03.115934 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:03.115896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"4b606009c05836c352623db5c610a657e5844223042f2656a00d9c710906cbab"} Jun 08 22:48:03.886256 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:03.886224 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:03.886438 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:03.886341 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:03.886438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:03.886223 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:03.886438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:03.886363 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:03.886610 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:03.886480 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:03.886610 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:03.886527 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:04.121636 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:04.121410 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:48:04.122077 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:04.122057 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:48:05.123925 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.123883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" event={"ID":"7dbafa25-af8a-4c11-bd2d-a09e45d5ec29","Type":"ContainerStarted","Data":"9e9c8ff1781c8aa9a3d5dfd3e2c38a6c035fc70ebd6d1374152cc526601ed10c"} Jun 08 22:48:05.124786 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.124117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:05.125938 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.125911 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="39c8b91f43c7026cdc078713892dd54965da869ede177ac9a627348c4df69f80" exitCode=0 Jun 08 22:48:05.126054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.125961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"39c8b91f43c7026cdc078713892dd54965da869ede177ac9a627348c4df69f80"} Jun 08 22:48:05.126107 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.126084 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:48:05.126621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.126567 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bxqfp" Jun 08 22:48:05.140080 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.139928 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:05.151881 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.151805 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" podStartSLOduration=8.507487582 podStartE2EDuration="27.151793537s" totalImagesPullingTime="18.644305955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:05.151318046 +0000 UTC m=+27.708147913" watchObservedRunningTime="2026-06-08 22:48:05.151793537 +0000 UTC m=+27.708623377" Jun 08 22:48:05.886109 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.886070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:05.886309 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:05.886216 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:05.886309 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.886070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:05.886442 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:05.886329 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:05.886442 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:05.886070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:05.886545 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:05.886468 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:06.128663 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.128636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:06.129048 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.128709 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:06.143498 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.143417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:06.650312 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.650230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xswr7"] Jun 08 22:48:06.650468 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.650362 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:06.650522 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:06.650477 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:06.653014 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.652980 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw2sg"] Jun 08 22:48:06.653133 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.653070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:06.653193 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:06.653171 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:06.653577 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.653544 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q49tl"] Jun 08 22:48:06.653649 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:06.653629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:06.653727 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:06.653710 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:07.132896 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:07.132860 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="0df64acf0fb44dbbd0e6cb3ccca530b67704d1183ae0a572026d2fead1fba2b6" exitCode=0 Jun 08 22:48:07.133291 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:07.132945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"0df64acf0fb44dbbd0e6cb3ccca530b67704d1183ae0a572026d2fead1fba2b6"} Jun 08 22:48:07.886949 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:07.886914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:07.887138 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:07.887024 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:07.887138 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:07.887037 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:07.887254 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:07.887149 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:08.886468 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:08.886433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:08.886818 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:08.886543 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:09.139990 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:09.139901 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="c433e728d4ac4c421a97e8455228c24fe565f855a7a743a9c3576cb0e6f89b0b" exitCode=0 Jun 08 22:48:09.139990 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:09.139953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"c433e728d4ac4c421a97e8455228c24fe565f855a7a743a9c3576cb0e6f89b0b"} Jun 08 22:48:09.885582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:09.885546 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:09.885741 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:09.885548 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:09.885741 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:09.885659 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:09.885865 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:09.885774 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:10.886223 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:10.886193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:10.886695 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:10.886330 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw2sg" podUID="ea3e4fff-bc8f-49d2-aaa2-22b2851605e5" Jun 08 22:48:11.680278 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:11.680243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:11.680278 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:11.680284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:11.680562 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.680394 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 22:48:11.680562 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.680404 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:48:11.680562 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.680479 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret podName:ea3e4fff-bc8f-49d2-aaa2-22b2851605e5 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:43.680459814 +0000 UTC m=+66.237289633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret") pod "global-pull-secret-syncer-rw2sg" (UID: "ea3e4fff-bc8f-49d2-aaa2-22b2851605e5") : object "kube-system"/"original-pull-secret" not registered Jun 08 22:48:11.680562 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.680497 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:48:43.680489705 +0000 UTC m=+66.237319523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 22:48:11.781604 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:11.781571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:11.781787 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.781764 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 22:48:11.781843 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.781794 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 22:48:11.781843 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.781807 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4jvwn for pod openshift-network-diagnostics/network-check-target-xswr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:48:11.781933 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.781874 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn podName:e33781fe-0fe4-44d9-911b-95d9a6153c45 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:43.781854462 +0000 UTC m=+66.338684294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jvwn" (UniqueName: "kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn") pod "network-check-target-xswr7" (UID: "e33781fe-0fe4-44d9-911b-95d9a6153c45") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 22:48:11.885608 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:11.885579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:11.885780 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.885713 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:48:11.885780 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:11.885754 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:11.885865 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:11.885798 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xswr7" podUID="e33781fe-0fe4-44d9-911b-95d9a6153c45" Jun 08 22:48:12.293770 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.293738 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeReady" Jun 08 22:48:12.294224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.293900 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 22:48:12.324623 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.324535 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b49d67cb-9swn8"] Jun 08 22:48:12.349193 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.349162 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2mplf"] Jun 08 22:48:12.349366 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.349253 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.352046 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.351992 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 22:48:12.352182 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.352135 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bpm8k\"" Jun 08 22:48:12.352182 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.352135 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 22:48:12.352305 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.352222 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 22:48:12.358597 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.358100 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 22:48:12.363293 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.363269 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b49d67cb-9swn8"] Jun 08 22:48:12.363410 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.363313 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gdvwt"] Jun 08 22:48:12.363410 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.363387 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.365926 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.365906 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnlbh\"" Jun 08 22:48:12.366029 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.365936 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 22:48:12.366029 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.365979 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 22:48:12.381650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.381629 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mplf"] Jun 08 22:48:12.381650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.381662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gdvwt"] Jun 08 22:48:12.381822 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.381754 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.384465 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.384440 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 22:48:12.384699 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.384683 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 22:48:12.384796 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.384772 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 22:48:12.384994 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.384965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9wnvx\"" Jun 08 22:48:12.461901 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.461830 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:12.485600 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-config-volume\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7pqb\" (UniqueName: \"kubernetes.io/projected/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-kube-api-access-d7pqb\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485646 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdtv9\" (UniqueName: \"kubernetes.io/projected/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-kube-api-access-xdtv9\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.485771 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485852 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-tmp-dir\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6bsm\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.485985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-cert\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.486056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.486013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.486305 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.486066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.544399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.544350 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:12.587247 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587247 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-config-volume\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.587247 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7pqb\" (UniqueName: \"kubernetes.io/projected/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-kube-api-access-d7pqb\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587305 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:12.587318 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdtv9\" (UniqueName: \"kubernetes.io/projected/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-kube-api-access-xdtv9\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587498 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-tmp-dir\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.587549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587554 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6bsm\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-cert\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:12.587335 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:12.587709 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:13.087685188 +0000 UTC m=+35.644515026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:12.587725 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:12.587978 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:12.587786 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:13.08777044 +0000 UTC m=+35.644600275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:12.588295 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.587993 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.588295 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.588047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-config-volume\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.588295 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.588122 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.588452 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.588316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-tmp-dir\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.588627 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.588597 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.592796 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.592769 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.592896 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.592780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.592896 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.592810 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-cert\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.596544 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.596497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdtv9\" (UniqueName: \"kubernetes.io/projected/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-kube-api-access-xdtv9\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:12.597192 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.597170 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7pqb\" (UniqueName: \"kubernetes.io/projected/b6dc0d0a-6bed-4e3b-a018-711cbc4646fe-kube-api-access-d7pqb\") pod \"ingress-canary-gdvwt\" (UID: \"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe\") " pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.597360 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.597335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.597546 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.597528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6bsm\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:12.691740 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.691710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gdvwt" Jun 08 22:48:12.886518 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.886439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:12.889628 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:12.889605 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 22:48:13.093112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.093073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.093143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:13.093245 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:13.093270 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:13.093285 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:13.093342 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:14.093324652 +0000 UTC m=+36.650154473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:13.093366 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:13.093361 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:14.093350266 +0000 UTC m=+36.650180089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:13.641925 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.641886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gdvwt"] Jun 08 22:48:13.654789 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:48:13.654759 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dc0d0a_6bed_4e3b_a018_711cbc4646fe.slice/crio-a0d0ab19a86176721368499c5bc1f82dff2f3133d3ace17c01cb65e5ca23d2c7 WatchSource:0}: Error finding container a0d0ab19a86176721368499c5bc1f82dff2f3133d3ace17c01cb65e5ca23d2c7: Status 404 returned error can't find the container with id a0d0ab19a86176721368499c5bc1f82dff2f3133d3ace17c01cb65e5ca23d2c7 Jun 08 22:48:13.886411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.886192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:13.886551 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.886253 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:13.889897 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.889869 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 22:48:13.891212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.891193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2dq5\"" Jun 08 22:48:13.891319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.891217 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 22:48:13.891319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.891193 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 22:48:13.891495 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:13.891193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjrnx\"" Jun 08 22:48:14.104557 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:14.104489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:14.104557 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:14.104537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:14.104763 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:14.104663 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:14.104763 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:14.104709 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:14.104763 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:14.104725 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:14.104763 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:14.104747 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:16.104726505 +0000 UTC m=+38.661556323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:14.104763 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:14.104767 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:16.104754824 +0000 UTC m=+38.661584676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:14.152194 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:14.152157 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gdvwt" event={"ID":"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe","Type":"ContainerStarted","Data":"a0d0ab19a86176721368499c5bc1f82dff2f3133d3ace17c01cb65e5ca23d2c7"} Jun 08 22:48:14.154896 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:14.154870 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="883c9c74663210f96549e0ae1236e58f64b4c0171e70be0f9abdaa1a39b66ed1" exitCode=0 Jun 08 22:48:14.155013 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:14.154925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"883c9c74663210f96549e0ae1236e58f64b4c0171e70be0f9abdaa1a39b66ed1"} Jun 08 22:48:15.161522 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:15.161478 2556 generic.go:356] "Generic (PLEG): container finished" podID="ff06e628-ccf1-419e-a895-55905b0658c5" containerID="d1a6d641f266a52f3f00c7d059584a1e667bedc3344f85e721ca1d627df180bc" exitCode=0 Jun 08 22:48:15.161931 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:15.161533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerDied","Data":"d1a6d641f266a52f3f00c7d059584a1e667bedc3344f85e721ca1d627df180bc"} Jun 08 22:48:16.122171 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.122143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:16.122269 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.122197 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:16.122308 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:16.122291 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:16.122341 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:16.122319 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:16.122341 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:16.122333 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:16.122400 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:16.122348 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:20.122332006 +0000 UTC m=+42.679161858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:16.122400 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:16.122378 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:20.122366713 +0000 UTC m=+42.679196530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:16.165953 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.165913 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gdvwt" event={"ID":"b6dc0d0a-6bed-4e3b-a018-711cbc4646fe","Type":"ContainerStarted","Data":"80b306b60517070b9c5701eb9b5e64e6eec128999f09b72a9756f8877403dee4"} Jun 08 22:48:16.169470 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.169442 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-slh84" event={"ID":"ff06e628-ccf1-419e-a895-55905b0658c5","Type":"ContainerStarted","Data":"bd1698de085f0a2e54e730c1e7bd92eeb2e0d2003e780be5f71fb4f486b209a4"} Jun 08 22:48:16.181123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.181067 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gdvwt" podStartSLOduration=1.829247793 podStartE2EDuration="4.181049525s" totalImagesPullingTime="2.351801732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:16.180196836 +0000 UTC m=+38.737026707" watchObservedRunningTime="2026-06-08 22:48:16.181049525 +0000 UTC m=+38.737879366" Jun 08 22:48:16.203580 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.203533 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-slh84" podStartSLOduration=8.131214891 podStartE2EDuration="38.203518247s" totalImagesPullingTime="30.072303356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:16.200816799 +0000 UTC m=+38.757646656" watchObservedRunningTime="2026-06-08 22:48:16.203518247 +0000 UTC m=+38.760348086" Jun 08 22:48:16.320615 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.320526 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:16.420834 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:16.420796 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:17.878656 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:17.878622 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:17.925687 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:17.925652 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" limit=1024 Jun 08 22:48:20.155334 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:20.155297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:20.155438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:20.155502 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:20.155517 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:20.155548 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:20.155572 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:28.155555125 +0000 UTC m=+50.712384966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:20.155801 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:20.155614 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:28.155594586 +0000 UTC m=+50.712424421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:28.210337 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:28.210300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:28.210348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:28.210460 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:28.210471 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:28.210479 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:28.210521 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:44.210508712 +0000 UTC m=+66.767338546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:28.210850 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:28.210545 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:48:44.210526249 +0000 UTC m=+66.767356082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:38.145436 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:38.145397 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfp78" Jun 08 22:48:43.718803 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.718748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:48:43.718803 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.718809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:43.721776 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.721756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 22:48:43.721844 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.721826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 22:48:43.729617 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:43.729595 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 22:48:43.729700 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:43.729680 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:49:47.729657833 +0000 UTC m=+130.286487666 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : secret "metrics-daemon-secret" not found Jun 08 22:48:43.732804 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.732784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e4fff-bc8f-49d2-aaa2-22b2851605e5-original-pull-secret\") pod \"global-pull-secret-syncer-rw2sg\" (UID: \"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5\") " pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:43.796594 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.796566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw2sg" Jun 08 22:48:43.819143 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.819117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:43.821989 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.821967 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 22:48:43.832407 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.832388 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 22:48:43.843080 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.843055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvwn\" (UniqueName: \"kubernetes.io/projected/e33781fe-0fe4-44d9-911b-95d9a6153c45-kube-api-access-4jvwn\") pod \"network-check-target-xswr7\" (UID: \"e33781fe-0fe4-44d9-911b-95d9a6153c45\") " pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:43.909253 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.909227 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2dq5\"" Jun 08 22:48:43.916231 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.916206 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw2sg"] Jun 08 22:48:43.917324 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:43.917304 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:43.921886 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:48:43.921839 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3e4fff_bc8f_49d2_aaa2_22b2851605e5.slice/crio-4d08a12332c6f3890e2aa23e48f0c6ca653e0dde6e7e30006284542ff53ac3a4 WatchSource:0}: Error finding container 4d08a12332c6f3890e2aa23e48f0c6ca653e0dde6e7e30006284542ff53ac3a4: Status 404 returned error can't find the container with id 4d08a12332c6f3890e2aa23e48f0c6ca653e0dde6e7e30006284542ff53ac3a4 Jun 08 22:48:44.036552 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:44.036524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xswr7"] Jun 08 22:48:44.039578 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:48:44.039549 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33781fe_0fe4_44d9_911b_95d9a6153c45.slice/crio-9a8107cadfb015e202d8bd9d1fb07a57e0586bbae39c5742d0439501719493ff WatchSource:0}: Error finding container 9a8107cadfb015e202d8bd9d1fb07a57e0586bbae39c5742d0439501719493ff: Status 404 returned error can't find the container with id 9a8107cadfb015e202d8bd9d1fb07a57e0586bbae39c5742d0439501719493ff Jun 08 22:48:44.221571 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:44.221520 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:48:44.221762 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:44.221623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:48:44.221762 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:44.221685 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:48:44.221762 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:44.221700 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:48:44.221762 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:44.221739 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:48:44.221762 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:44.221753 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:49:16.22173763 +0000 UTC m=+98.778567461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:48:44.221960 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:48:44.221790 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:49:16.221774887 +0000 UTC m=+98.778604708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:48:44.235475 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:44.235445 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xswr7" event={"ID":"e33781fe-0fe4-44d9-911b-95d9a6153c45","Type":"ContainerStarted","Data":"9a8107cadfb015e202d8bd9d1fb07a57e0586bbae39c5742d0439501719493ff"} Jun 08 22:48:44.236539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:44.236510 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw2sg" event={"ID":"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5","Type":"ContainerStarted","Data":"4d08a12332c6f3890e2aa23e48f0c6ca653e0dde6e7e30006284542ff53ac3a4"} Jun 08 22:48:47.247836 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:47.247797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xswr7" event={"ID":"e33781fe-0fe4-44d9-911b-95d9a6153c45","Type":"ContainerStarted","Data":"30c8f0b990216bc8c11434d9fa809da2314fba2f43fddc40abb35da8df2d3436"} Jun 08 22:48:47.248256 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:47.247869 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:48:47.263258 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:47.263211 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xswr7" podStartSLOduration=66.473177072 podStartE2EDuration="1m9.263197239s" totalImagesPullingTime="2.790020167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:47.261802728 +0000 UTC m=+69.818632590" watchObservedRunningTime="2026-06-08 22:48:47.263197239 +0000 UTC m=+69.820027078" Jun 08 22:48:49.254793 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:49.254761 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw2sg" event={"ID":"ea3e4fff-bc8f-49d2-aaa2-22b2851605e5","Type":"ContainerStarted","Data":"4176b1bde680a391d4aa3f19dce6a9cfa45a7c9e9d7906ed9396e5f27e53d5b5"} Jun 08 22:48:49.268862 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:48:49.268812 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rw2sg" podStartSLOduration=66.292818187 podStartE2EDuration="1m11.268796274s" totalImagesPullingTime="4.975978087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:48:49.268271845 +0000 UTC m=+71.825101698" watchObservedRunningTime="2026-06-08 22:48:49.268796274 +0000 UTC m=+71.825626114" Jun 08 22:49:16.256608 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:49:16.256575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:49:16.256627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:16.256739 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:16.256802 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:16.256812 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:50:20.25679696 +0000 UTC m=+162.813626777 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:16.256818 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:49:16.257038 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:16.256872 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:50:20.256858521 +0000 UTC m=+162.813688340 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:49:18.253350 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:49:18.253323 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xswr7" Jun 08 22:49:47.767087 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:49:47.767050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:49:47.767592 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:47.767160 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 22:49:47.767592 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:49:47.767220 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs podName:147fe20d-97b5-45fb-9ee3-3ed43811b5ae nodeName:}" failed. No retries permitted until 2026-06-08 22:51:49.767207079 +0000 UTC m=+252.324036911 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs") pod "network-metrics-daemon-q49tl" (UID: "147fe20d-97b5-45fb-9ee3-3ed43811b5ae") : secret "metrics-daemon-secret" not found Jun 08 22:50:15.361654 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:15.361611 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" podUID="351d55f0-5e26-48ee-9154-969c626b34f9" Jun 08 22:50:15.373837 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:15.373807 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2mplf" podUID="14499a9d-c2d1-43aa-866e-7ddef1a80ef9" Jun 08 22:50:15.452770 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:50:15.452742 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mplf" Jun 08 22:50:15.452890 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:50:15.452746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:50:16.899483 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:16.899415 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q49tl" podUID="147fe20d-97b5-45fb-9ee3-3ed43811b5ae" Jun 08 22:50:20.296306 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:50:20.296267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:50:20.296306 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:50:20.296312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") pod \"image-registry-9b49d67cb-9swn8\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:50:20.297005 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:20.296403 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:50:20.297005 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:20.296403 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:50:20.297005 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:20.296484 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls podName:14499a9d-c2d1-43aa-866e-7ddef1a80ef9 nodeName:}" failed. No retries permitted until 2026-06-08 22:52:22.296468023 +0000 UTC m=+284.853297845 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls") pod "dns-default-2mplf" (UID: "14499a9d-c2d1-43aa-866e-7ddef1a80ef9") : secret "dns-default-metrics-tls" not found Jun 08 22:50:20.297005 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:20.296414 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b49d67cb-9swn8: secret "image-registry-tls" not found Jun 08 22:50:20.297005 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:50:20.296548 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls podName:351d55f0-5e26-48ee-9154-969c626b34f9 nodeName:}" failed. No retries permitted until 2026-06-08 22:52:22.296536089 +0000 UTC m=+284.853365923 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls") pod "image-registry-9b49d67cb-9swn8" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9") : secret "image-registry-tls" not found Jun 08 22:50:31.886597 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:50:31.886510 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:51:11.749341 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.749301 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4"] Jun 08 22:51:11.751574 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.751554 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.753979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.753954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5"] Jun 08 22:51:11.754522 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.754493 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 22:51:11.754630 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.754561 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.754630 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.754599 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 22:51:11.754630 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.754620 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-58dnv\"" Jun 08 22:51:11.754818 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.754803 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.755580 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.755561 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc"] Jun 08 22:51:11.755703 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.755688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" Jun 08 22:51:11.757413 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.757390 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zzrsq"] Jun 08 22:51:11.757533 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.757501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.758622 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.758601 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.759056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.758826 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.759056 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.758689 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z9rlt\"" Jun 08 22:51:11.761503 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.760129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.761503 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.760801 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.761503 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.761102 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p9qbv\"" Jun 08 22:51:11.761503 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.761134 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 22:51:11.761503 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.761452 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.763586 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.763562 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.764021 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.764000 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4"] Jun 08 22:51:11.764987 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.764965 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.764987 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.764980 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 22:51:11.765138 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.764990 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 22:51:11.765138 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.765009 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gqwt4\"" Jun 08 22:51:11.772023 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.772004 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5"] Jun 08 22:51:11.772134 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.772067 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 22:51:11.772850 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.772832 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc"] Jun 08 22:51:11.774649 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.774627 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zzrsq"] Jun 08 22:51:11.836134 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zws8n\" (UniqueName: \"kubernetes.io/projected/9104dc7f-2985-41e1-bd55-32b6132e9efd-kube-api-access-zws8n\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.836266 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.836266 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/667997e2-2856-45cd-a9b0-8e17eba4a48f-serving-cert\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.836266 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6jx\" (UniqueName: \"kubernetes.io/projected/667997e2-2856-45cd-a9b0-8e17eba4a48f-kube-api-access-cr6jx\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.836266 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-config\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.836266 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.836453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwp2x\" (UniqueName: \"kubernetes.io/projected/3bec64fa-bffa-43d6-bca1-0a8dba1506ab-kube-api-access-qwp2x\") pod \"volume-data-source-validator-78dd696465-s5qr5\" (UID: \"3bec64fa-bffa-43d6-bca1-0a8dba1506ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" Jun 08 22:51:11.836453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wcd6\" (UniqueName: \"kubernetes.io/projected/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-kube-api-access-6wcd6\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.836453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-trusted-ca\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.836453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.836325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-config\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.844330 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.844309 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj"] Jun 08 22:51:11.846337 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.846322 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:11.848848 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.848831 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 22:51:11.848848 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.848841 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 22:51:11.848993 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.848901 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.848993 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.848901 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-khxpn\"" Jun 08 22:51:11.848993 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.848938 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.850600 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.850572 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p"] Jun 08 22:51:11.852490 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.852474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:11.866713 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.866693 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 22:51:11.866811 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.866730 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 22:51:11.875366 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.875350 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6wjjg\"" Jun 08 22:51:11.886260 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.886242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 22:51:11.886330 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.886249 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 22:51:11.889922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.889904 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj"] Jun 08 22:51:11.902770 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.902738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p"] Jun 08 22:51:11.937250 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.937357 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:11.937357 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgf7j\" (UniqueName: \"kubernetes.io/projected/bcc3df8b-9214-4c1e-b7b9-932e754754fd-kube-api-access-kgf7j\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:11.937357 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zws8n\" (UniqueName: \"kubernetes.io/projected/9104dc7f-2985-41e1-bd55-32b6132e9efd-kube-api-access-zws8n\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.937499 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86edf007-30d8-4681-a3d8-79c624b92c43-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:11.937499 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:11.937377 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:51:11.937499 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:11.937467 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls podName:9104dc7f-2985-41e1-bd55-32b6132e9efd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:12.437447546 +0000 UTC m=+214.994277382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7rbtc" (UID: "9104dc7f-2985-41e1-bd55-32b6132e9efd") : secret "samples-operator-tls" not found Jun 08 22:51:11.937499 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6jx\" (UniqueName: \"kubernetes.io/projected/667997e2-2856-45cd-a9b0-8e17eba4a48f-kube-api-access-cr6jx\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.937674 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/667997e2-2856-45cd-a9b0-8e17eba4a48f-serving-cert\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.937674 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wcd6\" (UniqueName: \"kubernetes.io/projected/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-kube-api-access-6wcd6\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.937674 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcc3df8b-9214-4c1e-b7b9-932e754754fd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:11.937674 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwp2x\" (UniqueName: \"kubernetes.io/projected/3bec64fa-bffa-43d6-bca1-0a8dba1506ab-kube-api-access-qwp2x\") pod \"volume-data-source-validator-78dd696465-s5qr5\" (UID: \"3bec64fa-bffa-43d6-bca1-0a8dba1506ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-config\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86edf007-30d8-4681-a3d8-79c624b92c43-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2lv\" (UniqueName: \"kubernetes.io/projected/86edf007-30d8-4681-a3d8-79c624b92c43-kube-api-access-jt2lv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-trusted-ca\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.937858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.937847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-config\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.938361 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.938343 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-config\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.938631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.938607 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-config\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.938850 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.938833 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667997e2-2856-45cd-a9b0-8e17eba4a48f-trusted-ca\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.940004 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.939983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/667997e2-2856-45cd-a9b0-8e17eba4a48f-serving-cert\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.940143 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.940124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.944937 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.944916 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp"] Jun 08 22:51:11.947385 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.947367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:11.949964 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.949945 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 22:51:11.950095 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.949996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rjwwg\"" Jun 08 22:51:11.950272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.950014 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 22:51:11.950524 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.950494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zws8n\" (UniqueName: \"kubernetes.io/projected/9104dc7f-2985-41e1-bd55-32b6132e9efd-kube-api-access-zws8n\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:11.951342 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.951327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwp2x\" (UniqueName: \"kubernetes.io/projected/3bec64fa-bffa-43d6-bca1-0a8dba1506ab-kube-api-access-qwp2x\") pod \"volume-data-source-validator-78dd696465-s5qr5\" (UID: \"3bec64fa-bffa-43d6-bca1-0a8dba1506ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" Jun 08 22:51:11.952038 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.952005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6jx\" (UniqueName: \"kubernetes.io/projected/667997e2-2856-45cd-a9b0-8e17eba4a48f-kube-api-access-cr6jx\") pod \"console-operator-668fdbf85c-zzrsq\" (UID: \"667997e2-2856-45cd-a9b0-8e17eba4a48f\") " pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:11.952373 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.952354 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wcd6\" (UniqueName: \"kubernetes.io/projected/a87a00a2-8cc7-4e30-abde-0390b8b4f5d1-kube-api-access-6wcd6\") pod \"service-ca-operator-6bc5ff68f5-r77t4\" (UID: \"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:11.957582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:11.957563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp"] Jun 08 22:51:12.038868 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.038868 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgf7j\" (UniqueName: \"kubernetes.io/projected/bcc3df8b-9214-4c1e-b7b9-932e754754fd-kube-api-access-kgf7j\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.038868 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86edf007-30d8-4681-a3d8-79c624b92c43-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcc3df8b-9214-4c1e-b7b9-932e754754fd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be4a3613-f8da-4ef2-b12c-115d13503555-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86edf007-30d8-4681-a3d8-79c624b92c43-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.038997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2lv\" (UniqueName: \"kubernetes.io/projected/86edf007-30d8-4681-a3d8-79c624b92c43-kube-api-access-jt2lv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.039042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.039123 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.039097 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:12.039415 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.039168 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:12.539149279 +0000 UTC m=+215.095979102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:12.039505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.039471 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86edf007-30d8-4681-a3d8-79c624b92c43-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.039681 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.039656 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcc3df8b-9214-4c1e-b7b9-932e754754fd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.041118 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.041101 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86edf007-30d8-4681-a3d8-79c624b92c43-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.047028 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.047004 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgf7j\" (UniqueName: \"kubernetes.io/projected/bcc3df8b-9214-4c1e-b7b9-932e754754fd-kube-api-access-kgf7j\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.047110 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.047047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2lv\" (UniqueName: \"kubernetes.io/projected/86edf007-30d8-4681-a3d8-79c624b92c43-kube-api-access-jt2lv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pc6gj\" (UID: \"86edf007-30d8-4681-a3d8-79c624b92c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.062962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.062946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" Jun 08 22:51:12.071189 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.071174 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" Jun 08 22:51:12.084548 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.084513 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:12.140205 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.140099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be4a3613-f8da-4ef2-b12c-115d13503555-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.140353 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.140212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.140395 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.140376 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:12.140572 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.140557 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:12.640530418 +0000 UTC m=+215.197360238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:12.140982 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.140956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be4a3613-f8da-4ef2-b12c-115d13503555-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.154906 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.154877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" Jun 08 22:51:12.201552 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.201517 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4"] Jun 08 22:51:12.205113 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:12.205088 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87a00a2_8cc7_4e30_abde_0390b8b4f5d1.slice/crio-aa6e5d69c3de3a36a34ae59f908869cd91cc7c2a6a82393a24f447da3a18ef3c WatchSource:0}: Error finding container aa6e5d69c3de3a36a34ae59f908869cd91cc7c2a6a82393a24f447da3a18ef3c: Status 404 returned error can't find the container with id aa6e5d69c3de3a36a34ae59f908869cd91cc7c2a6a82393a24f447da3a18ef3c Jun 08 22:51:12.219152 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.218545 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5"] Jun 08 22:51:12.227569 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:12.227520 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bec64fa_bffa_43d6_bca1_0a8dba1506ab.slice/crio-2aa91b71ccb358f5627f81c492e3ffaa0374cd9e1ce17487fc9bb3127058a8e7 WatchSource:0}: Error finding container 2aa91b71ccb358f5627f81c492e3ffaa0374cd9e1ce17487fc9bb3127058a8e7: Status 404 returned error can't find the container with id 2aa91b71ccb358f5627f81c492e3ffaa0374cd9e1ce17487fc9bb3127058a8e7 Jun 08 22:51:12.235271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.235240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zzrsq"] Jun 08 22:51:12.239573 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:12.239541 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667997e2_2856_45cd_a9b0_8e17eba4a48f.slice/crio-7651c9584a55fb7a11b8385e35016cca54610145a2d5fd90c8f784efdf91374e WatchSource:0}: Error finding container 7651c9584a55fb7a11b8385e35016cca54610145a2d5fd90c8f784efdf91374e: Status 404 returned error can't find the container with id 7651c9584a55fb7a11b8385e35016cca54610145a2d5fd90c8f784efdf91374e Jun 08 22:51:12.301445 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.301365 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj"] Jun 08 22:51:12.303951 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:12.303928 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86edf007_30d8_4681_a3d8_79c624b92c43.slice/crio-03bbad69bcb6b5fa19e729fbe7211b39235af2eed22d27485fadfca85f43abf6 WatchSource:0}: Error finding container 03bbad69bcb6b5fa19e729fbe7211b39235af2eed22d27485fadfca85f43abf6: Status 404 returned error can't find the container with id 03bbad69bcb6b5fa19e729fbe7211b39235af2eed22d27485fadfca85f43abf6 Jun 08 22:51:12.442789 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.442761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:12.442914 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.442877 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:51:12.442957 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.442927 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls podName:9104dc7f-2985-41e1-bd55-32b6132e9efd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:13.442913451 +0000 UTC m=+215.999743270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7rbtc" (UID: "9104dc7f-2985-41e1-bd55-32b6132e9efd") : secret "samples-operator-tls" not found Jun 08 22:51:12.543636 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.543607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:12.543756 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.543742 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:12.543809 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.543799 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:13.543784403 +0000 UTC m=+216.100614226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:12.585452 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.585374 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" event={"ID":"3bec64fa-bffa-43d6-bca1-0a8dba1506ab","Type":"ContainerStarted","Data":"2aa91b71ccb358f5627f81c492e3ffaa0374cd9e1ce17487fc9bb3127058a8e7"} Jun 08 22:51:12.586559 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.586537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" event={"ID":"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1","Type":"ContainerStarted","Data":"aa6e5d69c3de3a36a34ae59f908869cd91cc7c2a6a82393a24f447da3a18ef3c"} Jun 08 22:51:12.587581 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.587560 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" event={"ID":"86edf007-30d8-4681-a3d8-79c624b92c43","Type":"ContainerStarted","Data":"03bbad69bcb6b5fa19e729fbe7211b39235af2eed22d27485fadfca85f43abf6"} Jun 08 22:51:12.588552 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.588531 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" event={"ID":"667997e2-2856-45cd-a9b0-8e17eba4a48f","Type":"ContainerStarted","Data":"7651c9584a55fb7a11b8385e35016cca54610145a2d5fd90c8f784efdf91374e"} Jun 08 22:51:12.644960 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:12.644932 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:12.645097 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.645077 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:12.645160 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:12.645143 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:13.645127593 +0000 UTC m=+216.201957415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:13.452537 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:13.452436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:13.452537 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.452531 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:51:13.452922 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.452588 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls podName:9104dc7f-2985-41e1-bd55-32b6132e9efd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:15.452570031 +0000 UTC m=+218.009399862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7rbtc" (UID: "9104dc7f-2985-41e1-bd55-32b6132e9efd") : secret "samples-operator-tls" not found Jun 08 22:51:13.553021 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:13.552910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:13.553170 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.553050 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:13.553170 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.553115 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:15.553097506 +0000 UTC m=+218.109927329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:13.595218 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:13.594709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" event={"ID":"3bec64fa-bffa-43d6-bca1-0a8dba1506ab","Type":"ContainerStarted","Data":"e9a8109427d708ee2dde6eb9fb132af3c9f0d3bd49f5d71247665e7cae7eacad"} Jun 08 22:51:13.610769 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:13.610719 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-s5qr5" podStartSLOduration=1.406602979 podStartE2EDuration="2.6107027s" totalImagesPullingTime="1.204099721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:13.609977122 +0000 UTC m=+216.166806961" watchObservedRunningTime="2026-06-08 22:51:13.6107027 +0000 UTC m=+216.167532551" Jun 08 22:51:13.653816 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:13.653782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:13.653993 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.653971 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:13.654066 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:13.654055 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:15.654034015 +0000 UTC m=+218.210863836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:15.467806 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.467721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:15.468150 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.467862 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:51:15.468150 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.467923 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls podName:9104dc7f-2985-41e1-bd55-32b6132e9efd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:19.467908134 +0000 UTC m=+222.024737952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7rbtc" (UID: "9104dc7f-2985-41e1-bd55-32b6132e9efd") : secret "samples-operator-tls" not found Jun 08 22:51:15.568671 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.568640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:15.568828 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.568779 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:15.568870 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.568838 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:19.568823015 +0000 UTC m=+222.125652832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:15.605921 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.605886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" event={"ID":"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1","Type":"ContainerStarted","Data":"4a53ddc37e1495384fcf81ee068a98d8f5f465203bf070b1f2c9f2717cfad337"} Jun 08 22:51:15.607592 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.607567 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" event={"ID":"86edf007-30d8-4681-a3d8-79c624b92c43","Type":"ContainerStarted","Data":"e4f37c58e17a88eefdad3bc22e53fb0571df231c02570fb149df35a7130bb655"} Jun 08 22:51:15.609322 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.609299 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/0.log" Jun 08 22:51:15.609451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.609340 2556 generic.go:356] "Generic (PLEG): container finished" podID="667997e2-2856-45cd-a9b0-8e17eba4a48f" containerID="3b272178798b059ed2ed2cf65e2353f56cf74beba39a3e6adb3b693c0bbdc532" exitCode=255 Jun 08 22:51:15.609451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.609380 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" event={"ID":"667997e2-2856-45cd-a9b0-8e17eba4a48f","Type":"ContainerDied","Data":"3b272178798b059ed2ed2cf65e2353f56cf74beba39a3e6adb3b693c0bbdc532"} Jun 08 22:51:15.609647 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.609630 2556 scope.go:117] "RemoveContainer" containerID="3b272178798b059ed2ed2cf65e2353f56cf74beba39a3e6adb3b693c0bbdc532" Jun 08 22:51:15.620205 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.620008 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" podStartSLOduration=1.6905457130000001 podStartE2EDuration="4.61999292s" totalImagesPullingTime="2.929447207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:15.619808741 +0000 UTC m=+218.176638582" watchObservedRunningTime="2026-06-08 22:51:15.61999292 +0000 UTC m=+218.176822742" Jun 08 22:51:15.655584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.655542 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" podStartSLOduration=1.8296941690000001 podStartE2EDuration="4.65552538s" totalImagesPullingTime="2.825831211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:15.654377364 +0000 UTC m=+218.211207218" watchObservedRunningTime="2026-06-08 22:51:15.65552538 +0000 UTC m=+218.212355219" Jun 08 22:51:15.669541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:15.669515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:15.669692 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.669671 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:15.669760 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:15.669747 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:19.669728129 +0000 UTC m=+222.226557953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:16.148727 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.148640 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r"] Jun 08 22:51:16.151777 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.151762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" Jun 08 22:51:16.154487 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.154457 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zn5lh\"" Jun 08 22:51:16.154591 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.154517 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 22:51:16.155605 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.155590 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 22:51:16.161196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.161177 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r"] Jun 08 22:51:16.274788 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.274762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrr6\" (UniqueName: \"kubernetes.io/projected/d6b65e61-e27c-404f-b0d4-89845a05612f-kube-api-access-rnrr6\") pod \"migrator-955ffdf5f-g827r\" (UID: \"d6b65e61-e27c-404f-b0d4-89845a05612f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" Jun 08 22:51:16.375711 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.375681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrr6\" (UniqueName: \"kubernetes.io/projected/d6b65e61-e27c-404f-b0d4-89845a05612f-kube-api-access-rnrr6\") pod \"migrator-955ffdf5f-g827r\" (UID: \"d6b65e61-e27c-404f-b0d4-89845a05612f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" Jun 08 22:51:16.384453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.384395 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrr6\" (UniqueName: \"kubernetes.io/projected/d6b65e61-e27c-404f-b0d4-89845a05612f-kube-api-access-rnrr6\") pod \"migrator-955ffdf5f-g827r\" (UID: \"d6b65e61-e27c-404f-b0d4-89845a05612f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" Jun 08 22:51:16.461342 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.461284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" Jun 08 22:51:16.577511 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.577477 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r"] Jun 08 22:51:16.580673 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:16.580648 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b65e61_e27c_404f_b0d4_89845a05612f.slice/crio-7334a8cb46da6e9b9ccc2dfbc416f24c2c8a1e39b04fd79b86f3d80d9f70a0fb WatchSource:0}: Error finding container 7334a8cb46da6e9b9ccc2dfbc416f24c2c8a1e39b04fd79b86f3d80d9f70a0fb: Status 404 returned error can't find the container with id 7334a8cb46da6e9b9ccc2dfbc416f24c2c8a1e39b04fd79b86f3d80d9f70a0fb Jun 08 22:51:16.614223 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614202 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:51:16.614646 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/0.log" Jun 08 22:51:16.614724 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614666 2556 generic.go:356] "Generic (PLEG): container finished" podID="667997e2-2856-45cd-a9b0-8e17eba4a48f" containerID="fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824" exitCode=255 Jun 08 22:51:16.614783 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" event={"ID":"667997e2-2856-45cd-a9b0-8e17eba4a48f","Type":"ContainerDied","Data":"fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824"} Jun 08 22:51:16.614826 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614816 2556 scope.go:117] "RemoveContainer" containerID="3b272178798b059ed2ed2cf65e2353f56cf74beba39a3e6adb3b693c0bbdc532" Jun 08 22:51:16.614991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.614947 2556 scope.go:117] "RemoveContainer" containerID="fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824" Jun 08 22:51:16.615161 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:16.615121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zzrsq_openshift-console-operator(667997e2-2856-45cd-a9b0-8e17eba4a48f)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" podUID="667997e2-2856-45cd-a9b0-8e17eba4a48f" Jun 08 22:51:16.615944 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:16.615927 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" event={"ID":"d6b65e61-e27c-404f-b0d4-89845a05612f","Type":"ContainerStarted","Data":"7334a8cb46da6e9b9ccc2dfbc416f24c2c8a1e39b04fd79b86f3d80d9f70a0fb"} Jun 08 22:51:17.621808 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:17.621775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" event={"ID":"d6b65e61-e27c-404f-b0d4-89845a05612f","Type":"ContainerStarted","Data":"3ba00591dd3961b5b2961967b95d3e33453eb9d24c1d4dc6f1df7138bfc9d1df"} Jun 08 22:51:17.622162 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:17.621887 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" event={"ID":"d6b65e61-e27c-404f-b0d4-89845a05612f","Type":"ContainerStarted","Data":"e2227060daa0a2125d78030986e74b498f1204801e7d829ae6e77c99b48753ab"} Jun 08 22:51:17.627257 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:17.627238 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:51:17.627544 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:17.627529 2556 scope.go:117] "RemoveContainer" containerID="fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824" Jun 08 22:51:17.627671 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:17.627654 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zzrsq_openshift-console-operator(667997e2-2856-45cd-a9b0-8e17eba4a48f)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" podUID="667997e2-2856-45cd-a9b0-8e17eba4a48f" Jun 08 22:51:17.652174 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:17.652124 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-g827r" podStartSLOduration=0.738195797 podStartE2EDuration="1.652106654s" totalImagesPullingTime="913.910857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:17.636146969 +0000 UTC m=+220.192976810" watchObservedRunningTime="2026-06-08 22:51:17.652106654 +0000 UTC m=+220.208936494" Jun 08 22:51:19.160832 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:19.160803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-splbb_ef23a427-e719-4c05-bc76-fa0efd5c8f17/dns-node-resolver/0.log" Jun 08 22:51:19.499454 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:19.499412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:19.499608 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.499579 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:51:19.499649 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.499639 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls podName:9104dc7f-2985-41e1-bd55-32b6132e9efd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:27.499623712 +0000 UTC m=+230.056453547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7rbtc" (UID: "9104dc7f-2985-41e1-bd55-32b6132e9efd") : secret "samples-operator-tls" not found Jun 08 22:51:19.600784 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:19.600753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:19.600919 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.600894 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:19.600971 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.600961 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:27.600946297 +0000 UTC m=+230.157776115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:19.701887 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:19.701856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:19.702058 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.702011 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:19.702126 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:19.702076 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:27.702057989 +0000 UTC m=+230.258887809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:20.161343 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:20.161315 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddz4r_2e1b96d2-ad5d-409b-9453-f23956fe864b/node-ca/0.log" Jun 08 22:51:20.961461 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:20.961414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gdvwt_b6dc0d0a-6bed-4e3b-a018-711cbc4646fe/serve-healthcheck-canary/0.log" Jun 08 22:51:21.361839 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:21.361803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-g827r_d6b65e61-e27c-404f-b0d4-89845a05612f/migrator/0.log" Jun 08 22:51:21.561704 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:21.561675 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-g827r_d6b65e61-e27c-404f-b0d4-89845a05612f/graceful-termination/0.log" Jun 08 22:51:21.761901 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:21.761863 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pc6gj_86edf007-30d8-4681-a3d8-79c624b92c43/kube-storage-version-migrator-operator/0.log" Jun 08 22:51:22.085138 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:22.085055 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:22.085138 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:22.085108 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:22.085435 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:22.085406 2556 scope.go:117] "RemoveContainer" containerID="fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824" Jun 08 22:51:22.085576 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:22.085558 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zzrsq_openshift-console-operator(667997e2-2856-45cd-a9b0-8e17eba4a48f)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" podUID="667997e2-2856-45cd-a9b0-8e17eba4a48f" Jun 08 22:51:27.565631 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.565595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:27.567988 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.567958 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9104dc7f-2985-41e1-bd55-32b6132e9efd-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7rbtc\" (UID: \"9104dc7f-2985-41e1-bd55-32b6132e9efd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:27.666148 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.666117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:27.666293 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:27.666260 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:27.666332 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:27.666322 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls podName:bcc3df8b-9214-4c1e-b7b9-932e754754fd nodeName:}" failed. No retries permitted until 2026-06-08 22:51:43.666305018 +0000 UTC m=+246.223134836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-f6x2p" (UID: "bcc3df8b-9214-4c1e-b7b9-932e754754fd") : secret "cluster-monitoring-operator-tls" not found Jun 08 22:51:27.678618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.678600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" Jun 08 22:51:27.767125 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.767092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:27.767261 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:27.767238 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 22:51:27.767332 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:27.767319 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert podName:be4a3613-f8da-4ef2-b12c-115d13503555 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:43.767295012 +0000 UTC m=+246.324124832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zrwkp" (UID: "be4a3613-f8da-4ef2-b12c-115d13503555") : secret "networking-console-plugin-cert" not found Jun 08 22:51:27.796722 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:27.796694 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc"] Jun 08 22:51:28.092162 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.092082 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b49d67cb-9swn8"] Jun 08 22:51:28.092305 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:28.092286 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" podUID="351d55f0-5e26-48ee-9154-969c626b34f9" Jun 08 22:51:28.659212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.659175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" event={"ID":"9104dc7f-2985-41e1-bd55-32b6132e9efd","Type":"ContainerStarted","Data":"317438122b21b40e4b576fd2bc59f49bd2eeb90b60a846ddc7e6dd0cc9d15c37"} Jun 08 22:51:28.659212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.659205 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:51:28.665296 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.665276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:51:28.776863 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.776827 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6bsm\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777045 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.776897 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777045 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.776938 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777104 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777264 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777176 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777264 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777210 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration\") pod \"351d55f0-5e26-48ee-9154-969c626b34f9\" (UID: \"351d55f0-5e26-48ee-9154-969c626b34f9\") " Jun 08 22:51:28.777600 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777463 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:51:28.777600 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777547 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:51:28.777600 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777565 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:51:28.777851 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777657 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-trusted-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.777851 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777676 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/351d55f0-5e26-48ee-9154-969c626b34f9-ca-trust-extracted\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.777851 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.777690 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/351d55f0-5e26-48ee-9154-969c626b34f9-registry-certificates\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.780026 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.779993 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:51:28.780129 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.780042 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm" (OuterVolumeSpecName: "kube-api-access-r6bsm") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "kube-api-access-r6bsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:51:28.780129 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.780070 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:51:28.780129 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.780099 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "351d55f0-5e26-48ee-9154-969c626b34f9" (UID: "351d55f0-5e26-48ee-9154-969c626b34f9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:51:28.878757 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.878718 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-installation-pull-secrets\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.878757 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.878750 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/351d55f0-5e26-48ee-9154-969c626b34f9-image-registry-private-configuration\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.878757 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.878765 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6bsm\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-kube-api-access-r6bsm\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:28.879061 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:28.878773 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-bound-sa-token\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:29.303630 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.303590 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z4zmv"] Jun 08 22:51:29.310205 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.310176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.312930 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.312900 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 22:51:29.313049 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.312940 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 22:51:29.313049 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.313028 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 22:51:29.313049 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.313043 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 22:51:29.313277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.313261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcscd\"" Jun 08 22:51:29.316903 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.316873 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4zmv"] Jun 08 22:51:29.483708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.483671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.483861 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.483731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef032184-6c6f-47ab-8292-66427aac2a91-crio-socket\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.483861 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.483825 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxnd4\" (UniqueName: \"kubernetes.io/projected/ef032184-6c6f-47ab-8292-66427aac2a91-kube-api-access-mxnd4\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.483933 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.483865 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef032184-6c6f-47ab-8292-66427aac2a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.483933 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.483909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef032184-6c6f-47ab-8292-66427aac2a91-data-volume\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585039 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef032184-6c6f-47ab-8292-66427aac2a91-data-volume\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585195 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef032184-6c6f-47ab-8292-66427aac2a91-crio-socket\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585280 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef032184-6c6f-47ab-8292-66427aac2a91-crio-socket\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585280 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:29.585266 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 08 22:51:29.585391 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585325 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef032184-6c6f-47ab-8292-66427aac2a91-data-volume\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585391 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:29.585336 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls podName:ef032184-6c6f-47ab-8292-66427aac2a91 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:30.085315346 +0000 UTC m=+232.642145167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4zmv" (UID: "ef032184-6c6f-47ab-8292-66427aac2a91") : secret "insights-runtime-extractor-tls" not found Jun 08 22:51:29.585519 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxnd4\" (UniqueName: \"kubernetes.io/projected/ef032184-6c6f-47ab-8292-66427aac2a91-kube-api-access-mxnd4\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585519 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef032184-6c6f-47ab-8292-66427aac2a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.585989 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.585960 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef032184-6c6f-47ab-8292-66427aac2a91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.594364 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.594341 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxnd4\" (UniqueName: \"kubernetes.io/projected/ef032184-6c6f-47ab-8292-66427aac2a91-kube-api-access-mxnd4\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:29.664627 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.664594 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" event={"ID":"9104dc7f-2985-41e1-bd55-32b6132e9efd","Type":"ContainerStarted","Data":"7c96c077984a6e4c8dae2029a3444f730a43b7ce43c606c116f98b4699ff75fa"} Jun 08 22:51:29.664973 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.664657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" event={"ID":"9104dc7f-2985-41e1-bd55-32b6132e9efd","Type":"ContainerStarted","Data":"8d2c6fc2c6fdfac42d52ed0c8522a57f0cfa5d142c1086beaff92eba15029943"} Jun 08 22:51:29.664973 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.664688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b49d67cb-9swn8" Jun 08 22:51:29.680583 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.680539 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7rbtc" podStartSLOduration=17.032082325 podStartE2EDuration="18.680524272s" totalImagesPullingTime="1.648441947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:29.679737745 +0000 UTC m=+232.236567586" watchObservedRunningTime="2026-06-08 22:51:29.680524272 +0000 UTC m=+232.237354112" Jun 08 22:51:29.707649 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.707623 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b49d67cb-9swn8"] Jun 08 22:51:29.710887 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.710863 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9b49d67cb-9swn8"] Jun 08 22:51:29.887580 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.887511 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/351d55f0-5e26-48ee-9154-969c626b34f9-registry-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:51:29.889932 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:29.889906 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351d55f0-5e26-48ee-9154-969c626b34f9" path="/var/lib/kubelet/pods/351d55f0-5e26-48ee-9154-969c626b34f9/volumes" Jun 08 22:51:30.088577 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:30.088544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:30.088743 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:30.088693 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 08 22:51:30.088787 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:30.088759 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls podName:ef032184-6c6f-47ab-8292-66427aac2a91 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:31.088741574 +0000 UTC m=+233.645571394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4zmv" (UID: "ef032184-6c6f-47ab-8292-66427aac2a91") : secret "insights-runtime-extractor-tls" not found Jun 08 22:51:31.097766 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:31.097729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:31.098118 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:31.097874 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 08 22:51:31.098118 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:51:31.097948 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls podName:ef032184-6c6f-47ab-8292-66427aac2a91 nodeName:}" failed. No retries permitted until 2026-06-08 22:51:33.097932302 +0000 UTC m=+235.654762120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4zmv" (UID: "ef032184-6c6f-47ab-8292-66427aac2a91") : secret "insights-runtime-extractor-tls" not found Jun 08 22:51:33.112162 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.112128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:33.114405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.114377 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef032184-6c6f-47ab-8292-66427aac2a91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4zmv\" (UID: \"ef032184-6c6f-47ab-8292-66427aac2a91\") " pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:33.221817 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.221783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4zmv" Jun 08 22:51:33.346355 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.346320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4zmv"] Jun 08 22:51:33.349488 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:33.349457 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef032184_6c6f_47ab_8292_66427aac2a91.slice/crio-2a5f1e0075f9b72f5ece83a15d62b457e0784f30bc73748f043227268e857d5d WatchSource:0}: Error finding container 2a5f1e0075f9b72f5ece83a15d62b457e0784f30bc73748f043227268e857d5d: Status 404 returned error can't find the container with id 2a5f1e0075f9b72f5ece83a15d62b457e0784f30bc73748f043227268e857d5d Jun 08 22:51:33.680723 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.680644 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4zmv" event={"ID":"ef032184-6c6f-47ab-8292-66427aac2a91","Type":"ContainerStarted","Data":"8684b40f34fef36398f9f6d33017603ce502e2df5d1336a2922b2b34c952d1c4"} Jun 08 22:51:33.680723 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.680701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4zmv" event={"ID":"ef032184-6c6f-47ab-8292-66427aac2a91","Type":"ContainerStarted","Data":"2a5f1e0075f9b72f5ece83a15d62b457e0784f30bc73748f043227268e857d5d"} Jun 08 22:51:33.886040 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:33.886008 2556 scope.go:117] "RemoveContainer" containerID="fc563092896db4a7901beab8637871e0bf38c11452ef081ca7c10d7dd3b79824" Jun 08 22:51:34.686562 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:34.686527 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4zmv" event={"ID":"ef032184-6c6f-47ab-8292-66427aac2a91","Type":"ContainerStarted","Data":"2ed02efd06425c26c027500c52be1f77e58c68e22724a54813d9da97eb5049a1"} Jun 08 22:51:34.688768 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:34.688745 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:51:34.688885 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:34.688805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" event={"ID":"667997e2-2856-45cd-a9b0-8e17eba4a48f","Type":"ContainerStarted","Data":"410c637de41836d2c320a067b4bf566392e12e7b63a5ddf81ab2144c34710d0e"} Jun 08 22:51:34.689112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:34.689068 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:34.704792 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:34.704725 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" podStartSLOduration=20.812804829 podStartE2EDuration="23.704708489s" totalImagesPullingTime="2.89190366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:34.704333668 +0000 UTC m=+237.261163521" watchObservedRunningTime="2026-06-08 22:51:34.704708489 +0000 UTC m=+237.261538328" Jun 08 22:51:35.201701 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.201666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-zzrsq" Jun 08 22:51:35.365505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.365472 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-k55kh"] Jun 08 22:51:35.370066 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.370046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:35.372624 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.372603 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 22:51:35.372734 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.372612 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 22:51:35.372734 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.372647 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wptnp\"" Jun 08 22:51:35.376415 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.376363 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-k55kh"] Jun 08 22:51:35.428370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.428335 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhbc\" (UniqueName: \"kubernetes.io/projected/e6f6dca5-397c-4396-8a3f-9befaabd9b05-kube-api-access-wvhbc\") pod \"downloads-6657875f97-k55kh\" (UID: \"e6f6dca5-397c-4396-8a3f-9befaabd9b05\") " pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:35.529211 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.529181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhbc\" (UniqueName: \"kubernetes.io/projected/e6f6dca5-397c-4396-8a3f-9befaabd9b05-kube-api-access-wvhbc\") pod \"downloads-6657875f97-k55kh\" (UID: \"e6f6dca5-397c-4396-8a3f-9befaabd9b05\") " pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:35.537114 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.537082 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhbc\" (UniqueName: \"kubernetes.io/projected/e6f6dca5-397c-4396-8a3f-9befaabd9b05-kube-api-access-wvhbc\") pod \"downloads-6657875f97-k55kh\" (UID: \"e6f6dca5-397c-4396-8a3f-9befaabd9b05\") " pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:35.681843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.681820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:35.694615 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.694561 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4zmv" event={"ID":"ef032184-6c6f-47ab-8292-66427aac2a91","Type":"ContainerStarted","Data":"fc3075b4b5a7a6c5eaf4f33080dac4351eb72d6e16ea3b1a9483fd2f93be3356"} Jun 08 22:51:35.711955 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.711911 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z4zmv" podStartSLOduration=4.615205951 podStartE2EDuration="6.711896871s" totalImagesPullingTime="2.09669092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:51:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:35.7111286 +0000 UTC m=+238.267958464" watchObservedRunningTime="2026-06-08 22:51:35.711896871 +0000 UTC m=+238.268726708" Jun 08 22:51:35.809479 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:35.809379 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-k55kh"] Jun 08 22:51:35.812213 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:35.812181 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f6dca5_397c_4396_8a3f_9befaabd9b05.slice/crio-6d364e10b9977edbddaaac4eb05b2fa1909f4a1f5c90cb659014cd2423766dcf WatchSource:0}: Error finding container 6d364e10b9977edbddaaac4eb05b2fa1909f4a1f5c90cb659014cd2423766dcf: Status 404 returned error can't find the container with id 6d364e10b9977edbddaaac4eb05b2fa1909f4a1f5c90cb659014cd2423766dcf Jun 08 22:51:36.699214 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:36.699168 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-k55kh" event={"ID":"e6f6dca5-397c-4396-8a3f-9befaabd9b05","Type":"ContainerStarted","Data":"6d364e10b9977edbddaaac4eb05b2fa1909f4a1f5c90cb659014cd2423766dcf"} Jun 08 22:51:43.694277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.694236 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:43.696843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.696820 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcc3df8b-9214-4c1e-b7b9-932e754754fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-f6x2p\" (UID: \"bcc3df8b-9214-4c1e-b7b9-932e754754fd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:43.795002 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.794961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:43.797818 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.797789 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4a3613-f8da-4ef2-b12c-115d13503555-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zrwkp\" (UID: \"be4a3613-f8da-4ef2-b12c-115d13503555\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:43.963958 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.963873 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6wjjg\"" Jun 08 22:51:43.972043 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:43.972003 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" Jun 08 22:51:44.070498 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.070437 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rjwwg\"" Jun 08 22:51:44.078601 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.078533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" Jun 08 22:51:44.113712 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.113674 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p"] Jun 08 22:51:44.117788 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:44.117749 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc3df8b_9214_4c1e_b7b9_932e754754fd.slice/crio-a7c05e33f7f71321801418fa3519a7ad91f7580c76fd65d561949fe068752ce7 WatchSource:0}: Error finding container a7c05e33f7f71321801418fa3519a7ad91f7580c76fd65d561949fe068752ce7: Status 404 returned error can't find the container with id a7c05e33f7f71321801418fa3519a7ad91f7580c76fd65d561949fe068752ce7 Jun 08 22:51:44.225179 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.225100 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp"] Jun 08 22:51:44.228435 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:44.228396 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4a3613_f8da_4ef2_b12c_115d13503555.slice/crio-353bf37b9fd633d5c3ec1c00fd36886da205f6ed22dc0d7bffb46f2866f5609e WatchSource:0}: Error finding container 353bf37b9fd633d5c3ec1c00fd36886da205f6ed22dc0d7bffb46f2866f5609e: Status 404 returned error can't find the container with id 353bf37b9fd633d5c3ec1c00fd36886da205f6ed22dc0d7bffb46f2866f5609e Jun 08 22:51:44.728973 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.728935 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" event={"ID":"be4a3613-f8da-4ef2-b12c-115d13503555","Type":"ContainerStarted","Data":"353bf37b9fd633d5c3ec1c00fd36886da205f6ed22dc0d7bffb46f2866f5609e"} Jun 08 22:51:44.730864 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:44.730824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" event={"ID":"bcc3df8b-9214-4c1e-b7b9-932e754754fd","Type":"ContainerStarted","Data":"a7c05e33f7f71321801418fa3519a7ad91f7580c76fd65d561949fe068752ce7"} Jun 08 22:51:45.738048 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:45.737886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" event={"ID":"be4a3613-f8da-4ef2-b12c-115d13503555","Type":"ContainerStarted","Data":"bbd8f9953be6a5783bff9f0fb67404a65c35c01729f0bf66bbbcd5e9295dca1a"} Jun 08 22:51:45.753477 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:45.753371 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zrwkp" podStartSLOduration=33.444801454 podStartE2EDuration="34.753350357s" totalImagesPullingTime="1.308548903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:45.751977552 +0000 UTC m=+248.308807394" watchObservedRunningTime="2026-06-08 22:51:45.753350357 +0000 UTC m=+248.310180198" Jun 08 22:51:46.743039 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.743003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" event={"ID":"bcc3df8b-9214-4c1e-b7b9-932e754754fd","Type":"ContainerStarted","Data":"7392bbc9d8a6239a9f1aace8119a13c31b81820f55c6f027d464b4708f271734"} Jun 08 22:51:46.756993 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.756956 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n"] Jun 08 22:51:46.760489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.760468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:46.763022 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.762998 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nlx8d\"" Jun 08 22:51:46.763133 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.763019 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 22:51:46.770539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.770493 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-f6x2p" podStartSLOduration=33.615824337 podStartE2EDuration="35.770474617s" totalImagesPullingTime="2.15465028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:46.769955337 +0000 UTC m=+249.326785177" watchObservedRunningTime="2026-06-08 22:51:46.770474617 +0000 UTC m=+249.327304457" Jun 08 22:51:46.773219 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.773171 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n"] Jun 08 22:51:46.820752 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.820112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29793c23-7a67-4735-8288-f5e6744f7117-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-r8n6n\" (UID: \"29793c23-7a67-4735-8288-f5e6744f7117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:46.921159 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.921121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29793c23-7a67-4735-8288-f5e6744f7117-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-r8n6n\" (UID: \"29793c23-7a67-4735-8288-f5e6744f7117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:46.923914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:46.923889 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/29793c23-7a67-4735-8288-f5e6744f7117-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-r8n6n\" (UID: \"29793c23-7a67-4735-8288-f5e6744f7117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:47.069629 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:47.069538 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:49.844230 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:49.844187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:51:49.846833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:49.846806 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/147fe20d-97b5-45fb-9ee3-3ed43811b5ae-metrics-certs\") pod \"network-metrics-daemon-q49tl\" (UID: \"147fe20d-97b5-45fb-9ee3-3ed43811b5ae\") " pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:51:49.890249 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:49.890223 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjrnx\"" Jun 08 22:51:49.897463 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:49.897439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q49tl" Jun 08 22:51:50.082140 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.082108 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:51:50.098403 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.098270 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:51:50.098583 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.098403 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.101766 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.101738 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 22:51:50.101913 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.101797 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 22:51:50.102098 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.102078 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 22:51:50.102178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.102078 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l2wd6\"" Jun 08 22:51:50.103007 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.102981 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 22:51:50.103007 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.103017 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 22:51:50.146336 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.146336 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.146537 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.146537 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.146537 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6sbv\" (UniqueName: \"kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.146657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.146559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.246942 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.246905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247126 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.246949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247126 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247243 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247243 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247202 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6sbv\" (UniqueName: \"kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247344 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247252 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.247919 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247895 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.248059 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247966 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.248059 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.247975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.249749 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.249724 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.249895 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.249874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.254597 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.254570 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6sbv\" (UniqueName: \"kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv\") pod \"console-794bf8bf8b-6crjt\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:50.410790 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:50.410706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:51:53.883812 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:53.883783 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n"] Jun 08 22:51:53.895103 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:53.895073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29793c23_7a67_4735_8288_f5e6744f7117.slice/crio-68ddab6a8bf6854a885c1e3817f025c73a199f167c15413a148c1532cc79930d WatchSource:0}: Error finding container 68ddab6a8bf6854a885c1e3817f025c73a199f167c15413a148c1532cc79930d: Status 404 returned error can't find the container with id 68ddab6a8bf6854a885c1e3817f025c73a199f167c15413a148c1532cc79930d Jun 08 22:51:53.897641 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:53.897619 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q49tl"] Jun 08 22:51:53.917149 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:53.917007 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:51:54.006985 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:54.006957 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147fe20d_97b5_45fb_9ee3_3ed43811b5ae.slice/crio-013b446cc4ff458b8a543aef7e0e2e1fcab3bda7578d369a448015b6b38ea229 WatchSource:0}: Error finding container 013b446cc4ff458b8a543aef7e0e2e1fcab3bda7578d369a448015b6b38ea229: Status 404 returned error can't find the container with id 013b446cc4ff458b8a543aef7e0e2e1fcab3bda7578d369a448015b6b38ea229 Jun 08 22:51:54.008152 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:51:54.008120 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd180e9_55da_471e_a4c8_85fb6c419c00.slice/crio-07258b01701da0286132278cfb011cfabda335647ef8561c698c59a3b261ab4e WatchSource:0}: Error finding container 07258b01701da0286132278cfb011cfabda335647ef8561c698c59a3b261ab4e: Status 404 returned error can't find the container with id 07258b01701da0286132278cfb011cfabda335647ef8561c698c59a3b261ab4e Jun 08 22:51:54.775327 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.775257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q49tl" event={"ID":"147fe20d-97b5-45fb-9ee3-3ed43811b5ae","Type":"ContainerStarted","Data":"013b446cc4ff458b8a543aef7e0e2e1fcab3bda7578d369a448015b6b38ea229"} Jun 08 22:51:54.777743 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.777709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-k55kh" event={"ID":"e6f6dca5-397c-4396-8a3f-9befaabd9b05","Type":"ContainerStarted","Data":"fa3eb0e9267ed5b1dbd1b175252cabd534cc0f9807af3fe0e9f1a12cb2fe5c64"} Jun 08 22:51:54.779550 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.779500 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:54.782249 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.782199 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794bf8bf8b-6crjt" event={"ID":"8fd180e9-55da-471e-a4c8-85fb6c419c00","Type":"ContainerStarted","Data":"07258b01701da0286132278cfb011cfabda335647ef8561c698c59a3b261ab4e"} Jun 08 22:51:54.784676 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.784612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" event={"ID":"29793c23-7a67-4735-8288-f5e6744f7117","Type":"ContainerStarted","Data":"68ddab6a8bf6854a885c1e3817f025c73a199f167c15413a148c1532cc79930d"} Jun 08 22:51:54.792983 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.792909 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-k55kh" Jun 08 22:51:54.814226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:54.814163 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-k55kh" podStartSLOduration=1.5070206179999999 podStartE2EDuration="19.814144671s" totalImagesPullingTime="18.307124053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:54.79736678 +0000 UTC m=+257.354196620" watchObservedRunningTime="2026-06-08 22:51:54.814144671 +0000 UTC m=+257.370974512" Jun 08 22:51:55.794884 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:55.794347 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" event={"ID":"29793c23-7a67-4735-8288-f5e6744f7117","Type":"ContainerStarted","Data":"0877b6a02ac5488f5af9a4563f4e3e6efd4350a8b49294d325ad0162a02d99b4"} Jun 08 22:51:55.796031 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:55.795669 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:55.797990 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:55.797898 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q49tl" event={"ID":"147fe20d-97b5-45fb-9ee3-3ed43811b5ae","Type":"ContainerStarted","Data":"b377f2656479d737be7d4b910f0177f11b672c6e2bc3f639aa9b564c1d1d42e5"} Jun 08 22:51:55.804045 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:55.804021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" Jun 08 22:51:55.809903 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:55.809846 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-r8n6n" podStartSLOduration=8.167017128 podStartE2EDuration="9.809828472s" totalImagesPullingTime="1.642811344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:55.80930306 +0000 UTC m=+258.366132921" watchObservedRunningTime="2026-06-08 22:51:55.809828472 +0000 UTC m=+258.366658315" Jun 08 22:51:56.805768 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:56.805726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q49tl" event={"ID":"147fe20d-97b5-45fb-9ee3-3ed43811b5ae","Type":"ContainerStarted","Data":"e9d4f3659e63ebf4acec00ae96bc65fa8cc034a8e57fb48cd981ca74bf17da5c"} Jun 08 22:51:56.828485 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:56.828413 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q49tl" podStartSLOduration=257.210352427 podStartE2EDuration="4m18.828396704s" totalImagesPullingTime="1.618044277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:56.826979418 +0000 UTC m=+259.383809263" watchObservedRunningTime="2026-06-08 22:51:56.828396704 +0000 UTC m=+259.385226543" Jun 08 22:51:58.816766 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:58.816726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794bf8bf8b-6crjt" event={"ID":"8fd180e9-55da-471e-a4c8-85fb6c419c00","Type":"ContainerStarted","Data":"048fd67e40b7f420bdcd253fce1d8387a585a917ed2a83356790977846a2b162"} Jun 08 22:51:58.833626 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:51:58.833580 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794bf8bf8b-6crjt" podStartSLOduration=4.531745488 podStartE2EDuration="8.833563125s" totalImagesPullingTime="4.301817637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:51:58.832228738 +0000 UTC m=+261.389058578" watchObservedRunningTime="2026-06-08 22:51:58.833563125 +0000 UTC m=+261.390392965" Jun 08 22:52:00.411614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:00.411569 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:52:00.412159 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:00.411643 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:52:00.413303 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:00.413264 2556 patch_prober.go:28] interesting pod/console-794bf8bf8b-6crjt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 08 22:52:00.413434 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:00.413333 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794bf8bf8b-6crjt" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 08 22:52:01.149440 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.149381 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f"] Jun 08 22:52:01.180800 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.180764 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f"] Jun 08 22:52:01.180955 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.180821 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7"] Jun 08 22:52:01.181000 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.180979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.183843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.183789 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 22:52:01.183980 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.183864 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 22:52:01.183980 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.183864 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xxh5s\"" Jun 08 22:52:01.183980 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.183901 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 22:52:01.198844 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.198816 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nqq5g"] Jun 08 22:52:01.199551 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.199529 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.202097 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.202070 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 22:52:01.202335 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.202317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zz5m5\"" Jun 08 22:52:01.202448 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.202394 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 22:52:01.202448 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.202396 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 22:52:01.224049 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.224021 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7"] Jun 08 22:52:01.224167 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.224158 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.226882 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.226855 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ksq6q\"" Jun 08 22:52:01.227168 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.227151 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 22:52:01.227505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.227473 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 22:52:01.227505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.227493 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 22:52:01.247950 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.247919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.248059 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.247993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.248059 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.248059 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.248224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.248224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.248224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92f558b-15be-4dbf-b0ca-e76b41103bfb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.248224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8l52\" (UniqueName: \"kubernetes.io/projected/e92f558b-15be-4dbf-b0ca-e76b41103bfb-kube-api-access-x8l52\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.248395 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmkm\" (UniqueName: \"kubernetes.io/projected/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-api-access-bdmkm\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.248395 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.248281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.348780 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2h4\" (UniqueName: \"kubernetes.io/projected/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-kube-api-access-2d2h4\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.348945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.348945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348822 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.348945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.348945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-tls\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:52:01.348947 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.348962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-textfile\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:52:01.349005 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls podName:23c22ccd-3e4b-435f-a644-dfa3b34d4d9b nodeName:}" failed. No retries permitted until 2026-06-08 22:52:01.848984719 +0000 UTC m=+264.405814556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-llns7" (UID: "23c22ccd-3e4b-435f-a644-dfa3b34d4d9b") : secret "kube-state-metrics-tls" not found Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-sys\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-metrics-client-ca\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-root\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92f558b-15be-4dbf-b0ca-e76b41103bfb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8l52\" (UniqueName: \"kubernetes.io/projected/e92f558b-15be-4dbf-b0ca-e76b41103bfb-kube-api-access-x8l52\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmkm\" (UniqueName: \"kubernetes.io/projected/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-api-access-bdmkm\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-wtmp\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.349983 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.349891 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.350049 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.350023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92f558b-15be-4dbf-b0ca-e76b41103bfb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.350101 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.350052 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.350588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.350558 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.352278 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.352253 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.352556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.352538 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.352763 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.352741 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e92f558b-15be-4dbf-b0ca-e76b41103bfb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.360202 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.360178 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmkm\" (UniqueName: \"kubernetes.io/projected/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-api-access-bdmkm\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.360415 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.360391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8l52\" (UniqueName: \"kubernetes.io/projected/e92f558b-15be-4dbf-b0ca-e76b41103bfb-kube-api-access-x8l52\") pod \"openshift-state-metrics-65f78d5c66-tmq4f\" (UID: \"e92f558b-15be-4dbf-b0ca-e76b41103bfb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.450634 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-tls\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.450634 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450601 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-textfile\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-sys\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-metrics-client-ca\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-root\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-wtmp\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2h4\" (UniqueName: \"kubernetes.io/projected/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-kube-api-access-2d2h4\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-root\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.450805 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-sys\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.451018 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-wtmp\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.451029 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-textfile\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451747 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.451556 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-metrics-client-ca\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.451747 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.451613 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.453519 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.453494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-tls\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.453519 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.453501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.459011 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.458987 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2h4\" (UniqueName: \"kubernetes.io/projected/89c0f0ae-304d-4e64-a5ac-70b4410a80f4-kube-api-access-2d2h4\") pod \"node-exporter-nqq5g\" (UID: \"89c0f0ae-304d-4e64-a5ac-70b4410a80f4\") " pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.493694 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.493669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" Jun 08 22:52:01.534592 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.534561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqq5g" Jun 08 22:52:01.581098 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:01.581053 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c0f0ae_304d_4e64_a5ac_70b4410a80f4.slice/crio-e4a905a05e3c5efc7a6b0da548b3ed5852643c24a2857354c7c09ffd4d8d28c8 WatchSource:0}: Error finding container e4a905a05e3c5efc7a6b0da548b3ed5852643c24a2857354c7c09ffd4d8d28c8: Status 404 returned error can't find the container with id e4a905a05e3c5efc7a6b0da548b3ed5852643c24a2857354c7c09ffd4d8d28c8 Jun 08 22:52:01.681177 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.680887 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f"] Jun 08 22:52:01.683461 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:01.683428 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92f558b_15be_4dbf_b0ca_e76b41103bfb.slice/crio-7130da53fe8ea6d834fc89ec179add167d4f7bcab2bd7f23f19d080c0c8dc7aa WatchSource:0}: Error finding container 7130da53fe8ea6d834fc89ec179add167d4f7bcab2bd7f23f19d080c0c8dc7aa: Status 404 returned error can't find the container with id 7130da53fe8ea6d834fc89ec179add167d4f7bcab2bd7f23f19d080c0c8dc7aa Jun 08 22:52:01.830738 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.830702 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" event={"ID":"e92f558b-15be-4dbf-b0ca-e76b41103bfb","Type":"ContainerStarted","Data":"4a74406b7b34fcfe9602bff7e4cf3d9ebaf686767706693900228260d29f1576"} Jun 08 22:52:01.830865 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.830773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" event={"ID":"e92f558b-15be-4dbf-b0ca-e76b41103bfb","Type":"ContainerStarted","Data":"7130da53fe8ea6d834fc89ec179add167d4f7bcab2bd7f23f19d080c0c8dc7aa"} Jun 08 22:52:01.832178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.832147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqq5g" event={"ID":"89c0f0ae-304d-4e64-a5ac-70b4410a80f4","Type":"ContainerStarted","Data":"e4a905a05e3c5efc7a6b0da548b3ed5852643c24a2857354c7c09ffd4d8d28c8"} Jun 08 22:52:01.853621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.853588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:01.856183 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:01.856164 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c22ccd-3e4b-435f-a644-dfa3b34d4d9b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-llns7\" (UID: \"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:02.113584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.113545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" Jun 08 22:52:02.214369 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.214318 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:52:02.241136 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.240934 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:52:02.241136 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.241114 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.245603 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.244739 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7nbl\"" Jun 08 22:52:02.245603 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.244812 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 22:52:02.245603 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.245036 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 22:52:02.245603 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.245298 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 22:52:02.245603 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.245502 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 22:52:02.245964 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.245687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 22:52:02.245964 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.245930 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 22:52:02.249319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.246138 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 22:52:02.249319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.246450 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 22:52:02.249319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.246650 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 22:52:02.307672 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.307594 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7"] Jun 08 22:52:02.358355 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.358355 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.358355 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.358355 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358528 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.359286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.358615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxqz\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:52:02.460274 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:52:02.460349 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls podName:c557e252-0266-487a-9ca6-8b3223ce163e nodeName:}" failed. No retries permitted until 2026-06-08 22:52:02.960327672 +0000 UTC m=+265.517157491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e") : secret "alertmanager-main-tls" not found Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.460708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxqz\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.461874 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.460808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.467658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.468142 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.468168 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.468602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.468681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.469163 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.469179 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.469535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.469612 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.470956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.472196 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.472105 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.476836 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.476783 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxqz\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.840602 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.840555 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" event={"ID":"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b","Type":"ContainerStarted","Data":"61e34ed1c828f81b6304325130f57c79d23af3f0dd838e1d2e2544404d7ae46f"} Jun 08 22:52:02.842791 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.842750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" event={"ID":"e92f558b-15be-4dbf-b0ca-e76b41103bfb","Type":"ContainerStarted","Data":"02d9258b26697b239d4a71b78e7d1dbf3722fc7588028de134a563108008f5ac"} Jun 08 22:52:02.965783 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.965744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:02.968949 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:02.968914 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:03.156310 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.156236 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:52:03.759027 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.758985 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:52:03.761080 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:03.761054 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc557e252_0266_487a_9ca6_8b3223ce163e.slice/crio-c4e082e2ccf852c492da8ad6596fad414b1e0b4ae84ee5036d105c13938aa774 WatchSource:0}: Error finding container c4e082e2ccf852c492da8ad6596fad414b1e0b4ae84ee5036d105c13938aa774: Status 404 returned error can't find the container with id c4e082e2ccf852c492da8ad6596fad414b1e0b4ae84ee5036d105c13938aa774 Jun 08 22:52:03.860709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.860238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" event={"ID":"e92f558b-15be-4dbf-b0ca-e76b41103bfb","Type":"ContainerStarted","Data":"89a6eb7efaa364d836e6a6ca48ff0771b705aa8fdabad31812e5e2667ba68940"} Jun 08 22:52:03.863375 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.863296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqq5g" event={"ID":"89c0f0ae-304d-4e64-a5ac-70b4410a80f4","Type":"ContainerStarted","Data":"1e65e4e2c1f7242d4e650d889875d4c9bd3d430f39dbc3bad199c8ea3a8f5474"} Jun 08 22:52:03.864673 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.864649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"c4e082e2ccf852c492da8ad6596fad414b1e0b4ae84ee5036d105c13938aa774"} Jun 08 22:52:03.879244 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:03.879200 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tmq4f" podStartSLOduration=1.207043022 podStartE2EDuration="2.879186208s" totalImagesPullingTime="1.672143186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:03.87824881 +0000 UTC m=+266.435078652" watchObservedRunningTime="2026-06-08 22:52:03.879186208 +0000 UTC m=+266.436016047" Jun 08 22:52:04.141862 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.141786 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d5cf7b858-cks5r"] Jun 08 22:52:04.167116 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.167090 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5cf7b858-cks5r"] Jun 08 22:52:04.167277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.167196 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.169955 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.169927 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 22:52:04.170081 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170052 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7m599\"" Jun 08 22:52:04.170152 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170059 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 22:52:04.170289 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170268 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 22:52:04.170518 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170490 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 22:52:04.170626 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c3coemtco5oue\"" Jun 08 22:52:04.170626 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.170496 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 22:52:04.277075 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277260 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-grpc-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277260 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277371 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277371 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277371 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dl7\" (UniqueName: \"kubernetes.io/projected/a1ca081d-0e06-40c1-a6c2-20bec73fae52-kube-api-access-d6dl7\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277507 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.277507 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.277469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca081d-0e06-40c1-a6c2-20bec73fae52-metrics-client-ca\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.377986 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.377949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.377986 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.377989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca081d-0e06-40c1-a6c2-20bec73fae52-metrics-client-ca\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.378321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.378321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-grpc-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.378321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.378321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.378321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.379090 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dl7\" (UniqueName: \"kubernetes.io/projected/a1ca081d-0e06-40c1-a6c2-20bec73fae52-kube-api-access-d6dl7\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.379090 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.378937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ca081d-0e06-40c1-a6c2-20bec73fae52-metrics-client-ca\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.380766 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.380739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-grpc-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.380884 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.380778 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.380958 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.380923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.381019 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.380963 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.381019 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.380985 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.381127 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.381083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a1ca081d-0e06-40c1-a6c2-20bec73fae52-secret-thanos-querier-tls\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.386178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.386156 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dl7\" (UniqueName: \"kubernetes.io/projected/a1ca081d-0e06-40c1-a6c2-20bec73fae52-kube-api-access-d6dl7\") pod \"thanos-querier-6d5cf7b858-cks5r\" (UID: \"a1ca081d-0e06-40c1-a6c2-20bec73fae52\") " pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.478509 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.478450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:04.617152 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.617127 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5cf7b858-cks5r"] Jun 08 22:52:04.737320 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:04.737248 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ca081d_0e06_40c1_a6c2_20bec73fae52.slice/crio-85cc34a1143a5672405448596971e3bac6c05e46049e013e34a985db7fbf0db3 WatchSource:0}: Error finding container 85cc34a1143a5672405448596971e3bac6c05e46049e013e34a985db7fbf0db3: Status 404 returned error can't find the container with id 85cc34a1143a5672405448596971e3bac6c05e46049e013e34a985db7fbf0db3 Jun 08 22:52:04.872678 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.872644 2556 generic.go:356] "Generic (PLEG): container finished" podID="89c0f0ae-304d-4e64-a5ac-70b4410a80f4" containerID="1e65e4e2c1f7242d4e650d889875d4c9bd3d430f39dbc3bad199c8ea3a8f5474" exitCode=0 Jun 08 22:52:04.873067 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.872707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqq5g" event={"ID":"89c0f0ae-304d-4e64-a5ac-70b4410a80f4","Type":"ContainerDied","Data":"1e65e4e2c1f7242d4e650d889875d4c9bd3d430f39dbc3bad199c8ea3a8f5474"} Jun 08 22:52:04.875198 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.875086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" event={"ID":"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b","Type":"ContainerStarted","Data":"e083b78998dcbf329bed93af23f87585396da3d7049840a6fe45f1c2bff49c75"} Jun 08 22:52:04.876707 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:04.876624 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"85cc34a1143a5672405448596971e3bac6c05e46049e013e34a985db7fbf0db3"} Jun 08 22:52:05.884578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.884543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqq5g" event={"ID":"89c0f0ae-304d-4e64-a5ac-70b4410a80f4","Type":"ContainerStarted","Data":"f83a8e7905c684d4c027bbc07d4b0130e5f1d03e4e8f7806bde918f319f96b04"} Jun 08 22:52:05.885009 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.884608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqq5g" event={"ID":"89c0f0ae-304d-4e64-a5ac-70b4410a80f4","Type":"ContainerStarted","Data":"add25553cc3e8f4ef47eb84e155dc0f770809bab56052ee542bd3d3ba4980d93"} Jun 08 22:52:05.893696 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.893674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" event={"ID":"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b","Type":"ContainerStarted","Data":"a1e7600f43aff71cea5241741262d68f45008f05ba964266ef1060f7904546d9"} Jun 08 22:52:05.893802 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.893729 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" event={"ID":"23c22ccd-3e4b-435f-a644-dfa3b34d4d9b","Type":"ContainerStarted","Data":"32129f8a7f121ff20d1f01c6d845349bab43a936650914d6cd21e7dd8f67e9a1"} Jun 08 22:52:05.936167 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.935841 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nqq5g" podStartSLOduration=2.812372624 podStartE2EDuration="4.935821134s" totalImagesPullingTime="2.01820299s" totalInitContainerRuntime="105.24552ms" isStatefulPod=true podCreationTimestamp="2026-06-08 22:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:05.913129644 +0000 UTC m=+268.469959487" watchObservedRunningTime="2026-06-08 22:52:05.935821134 +0000 UTC m=+268.492650975" Jun 08 22:52:05.936748 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:05.936583 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-llns7" podStartSLOduration=2.491577122 podStartE2EDuration="4.936565798s" totalImagesPullingTime="2.444988676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:05.934014103 +0000 UTC m=+268.490843942" watchObservedRunningTime="2026-06-08 22:52:05.936565798 +0000 UTC m=+268.493395643" Jun 08 22:52:06.894508 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:06.894467 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2" exitCode=0 Jun 08 22:52:06.895037 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:06.894558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2"} Jun 08 22:52:07.903212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:07.903182 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"b56241bcc68bd56246964bcfd3e2cf5fe881ca648726d74cde1211412ed69a0d"} Jun 08 22:52:07.903668 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:07.903300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"d0f3828216bc972d19670e6339ab3d9c2bae3da0d3660d259f88f647179ef943"} Jun 08 22:52:07.903668 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:07.903355 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"af135ab2a89b974d2b13e366898c56d6a6912eaa2a727f5d1d918647555d7943"} Jun 08 22:52:09.916920 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.916851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"3c47ec5aa79fa7b40887d130d17905a9ba0945c1424bfb45128aa5b8e8b77b73"} Jun 08 22:52:09.917304 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.916934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"73e148f9b472f4240381d0dec0e5dce913e9cba5d2f13a592dcf5980424fe4fb"} Jun 08 22:52:09.920602 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.920573 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0"} Jun 08 22:52:09.920730 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.920659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39"} Jun 08 22:52:09.920730 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.920705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc"} Jun 08 22:52:09.920853 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.920750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64"} Jun 08 22:52:09.920853 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:09.920794 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b"} Jun 08 22:52:10.411780 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.411744 2556 patch_prober.go:28] interesting pod/console-794bf8bf8b-6crjt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 08 22:52:10.411975 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.411798 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794bf8bf8b-6crjt" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 08 22:52:10.927828 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.927788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerStarted","Data":"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1"} Jun 08 22:52:10.930738 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.930705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" event={"ID":"a1ca081d-0e06-40c1-a6c2-20bec73fae52","Type":"ContainerStarted","Data":"f6b26d0630d2bc17e111af97e3da27573d1e27ad952d748f7c5df00aa6d02373"} Jun 08 22:52:10.930912 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.930894 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:10.954582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.954539 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.530698152 podStartE2EDuration="8.95452505s" totalImagesPullingTime="4.403469242s" totalInitContainerRuntime="20.357656ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:52:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:10.951880253 +0000 UTC m=+273.508710107" watchObservedRunningTime="2026-06-08 22:52:10.95452505 +0000 UTC m=+273.511354889" Jun 08 22:52:10.971755 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:10.971709 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" podStartSLOduration=2.522545772 podStartE2EDuration="6.971694621s" totalImagesPullingTime="4.449148849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:52:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:10.969697095 +0000 UTC m=+273.526526937" watchObservedRunningTime="2026-06-08 22:52:10.971694621 +0000 UTC m=+273.528524462" Jun 08 22:52:16.940635 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:16.940604 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d5cf7b858-cks5r" Jun 08 22:52:18.454076 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:52:18.454041 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2mplf" podUID="14499a9d-c2d1-43aa-866e-7ddef1a80ef9" Jun 08 22:52:18.962858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:18.962830 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:20.411918 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:20.411871 2556 patch_prober.go:28] interesting pod/console-794bf8bf8b-6crjt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 08 22:52:20.412311 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:20.411976 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794bf8bf8b-6crjt" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 08 22:52:22.334673 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.334644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:22.336841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.336823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14499a9d-c2d1-43aa-866e-7ddef1a80ef9-metrics-tls\") pod \"dns-default-2mplf\" (UID: \"14499a9d-c2d1-43aa-866e-7ddef1a80ef9\") " pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:22.567051 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.567023 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnlbh\"" Jun 08 22:52:22.574099 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.574078 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:22.698955 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.698931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mplf"] Jun 08 22:52:22.700933 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:22.700901 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14499a9d_c2d1_43aa_866e_7ddef1a80ef9.slice/crio-68ebcb83d802d89c21fc80ae6566c5ce6b41c995f37bb82f2601a81d3ad172f5 WatchSource:0}: Error finding container 68ebcb83d802d89c21fc80ae6566c5ce6b41c995f37bb82f2601a81d3ad172f5: Status 404 returned error can't find the container with id 68ebcb83d802d89c21fc80ae6566c5ce6b41c995f37bb82f2601a81d3ad172f5 Jun 08 22:52:22.980545 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:22.980467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mplf" event={"ID":"14499a9d-c2d1-43aa-866e-7ddef1a80ef9","Type":"ContainerStarted","Data":"68ebcb83d802d89c21fc80ae6566c5ce6b41c995f37bb82f2601a81d3ad172f5"} Jun 08 22:52:24.992529 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:24.992500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mplf" event={"ID":"14499a9d-c2d1-43aa-866e-7ddef1a80ef9","Type":"ContainerStarted","Data":"a6306f2eeeb7ab2b968a14b73944f6d271abd9e81b03a8884094fccd01a69c1d"} Jun 08 22:52:25.998248 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:25.998219 2556 generic.go:356] "Generic (PLEG): container finished" podID="a87a00a2-8cc7-4e30-abde-0390b8b4f5d1" containerID="4a53ddc37e1495384fcf81ee068a98d8f5f465203bf070b1f2c9f2717cfad337" exitCode=0 Jun 08 22:52:25.998714 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:25.998287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" event={"ID":"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1","Type":"ContainerDied","Data":"4a53ddc37e1495384fcf81ee068a98d8f5f465203bf070b1f2c9f2717cfad337"} Jun 08 22:52:25.998714 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:25.998656 2556 scope.go:117] "RemoveContainer" containerID="4a53ddc37e1495384fcf81ee068a98d8f5f465203bf070b1f2c9f2717cfad337" Jun 08 22:52:25.999884 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:25.999864 2556 generic.go:356] "Generic (PLEG): container finished" podID="86edf007-30d8-4681-a3d8-79c624b92c43" containerID="e4f37c58e17a88eefdad3bc22e53fb0571df231c02570fb149df35a7130bb655" exitCode=0 Jun 08 22:52:25.999987 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:25.999941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" event={"ID":"86edf007-30d8-4681-a3d8-79c624b92c43","Type":"ContainerDied","Data":"e4f37c58e17a88eefdad3bc22e53fb0571df231c02570fb149df35a7130bb655"} Jun 08 22:52:26.000243 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:26.000226 2556 scope.go:117] "RemoveContainer" containerID="e4f37c58e17a88eefdad3bc22e53fb0571df231c02570fb149df35a7130bb655" Jun 08 22:52:26.001729 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:26.001695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mplf" event={"ID":"14499a9d-c2d1-43aa-866e-7ddef1a80ef9","Type":"ContainerStarted","Data":"2366a0063e4ca12a5affd8820952425c21141aa8f05e0d067c24539aa7cd83bd"} Jun 08 22:52:26.001859 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:26.001769 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:26.046964 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:26.046921 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2mplf" podStartSLOduration=251.960015504 podStartE2EDuration="4m14.046907283s" totalImagesPullingTime="2.086891779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:26.046103383 +0000 UTC m=+288.602933224" watchObservedRunningTime="2026-06-08 22:52:26.046907283 +0000 UTC m=+288.603737123" Jun 08 22:52:27.007671 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:27.007645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pc6gj" event={"ID":"86edf007-30d8-4681-a3d8-79c624b92c43","Type":"ContainerStarted","Data":"187e889ccb47d24101bd976c3a2644771dfaf199aea9681760b8bb7a6742e0e6"} Jun 08 22:52:27.009379 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:27.009351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r77t4" event={"ID":"a87a00a2-8cc7-4e30-abde-0390b8b4f5d1","Type":"ContainerStarted","Data":"2354ccc21de4f1aee4a295a50dfc9cab4bbb72a464bac4fa533c3729017da76a"} Jun 08 22:52:28.943806 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.943747 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:52:28.963411 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.963386 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.966758 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.966717 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 22:52:28.966910 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.966793 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 22:52:28.966910 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.966797 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 22:52:28.967035 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.967024 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 22:52:28.967100 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.967024 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 22:52:28.967100 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.967089 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4fzrt\"" Jun 08 22:52:28.967366 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.967346 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 22:52:28.967517 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.967386 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 22:52:28.968500 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968166 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 22:52:28.968500 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968345 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 22:52:28.968500 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968453 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 22:52:28.968707 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968497 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:52:28.968707 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968672 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-954mpn23oepph\"" Jun 08 22:52:28.968814 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968783 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 22:52:28.968870 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.968816 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 22:52:28.969727 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.969705 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 22:52:28.972821 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.972796 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 22:52:28.980906 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.980879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 22:52:28.985504 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.985482 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:52:28.988576 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.988922 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.988947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:28.989272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:28.989183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrrp\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090416 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090584 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrrp\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.090924 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.090927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.091546 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.091415 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.091682 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.091658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.091907 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.091879 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.092414 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.092392 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.093236 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.093213 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.093493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.093567 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.094082 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.094167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094539 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.094347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.094907 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.094883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.095226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.095184 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.095703 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.095663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.095797 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.095729 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.096111 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.096093 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.096578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.096555 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.096959 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.096935 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.097188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.097167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.097618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.097596 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.105828 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.105809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrrp\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp\") pod \"prometheus-k8s-0\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.282586 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.282555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:29.454114 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:29.454088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:52:29.455967 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:52:29.455934 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54c0ce1_69f3_428d_bc95_fc3e818c1f27.slice/crio-7f450274c8eb7a044c03b1fa43bfe14c933a2ec19f2adcd118fe48b46aa107ba WatchSource:0}: Error finding container 7f450274c8eb7a044c03b1fa43bfe14c933a2ec19f2adcd118fe48b46aa107ba: Status 404 returned error can't find the container with id 7f450274c8eb7a044c03b1fa43bfe14c933a2ec19f2adcd118fe48b46aa107ba Jun 08 22:52:30.023370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:30.023333 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" exitCode=0 Jun 08 22:52:30.023755 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:30.023438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} Jun 08 22:52:30.023755 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:30.023513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"7f450274c8eb7a044c03b1fa43bfe14c933a2ec19f2adcd118fe48b46aa107ba"} Jun 08 22:52:34.047026 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:34.046995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} Jun 08 22:52:34.047438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:34.047074 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} Jun 08 22:52:34.047438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:34.047120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} Jun 08 22:52:34.047438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:34.047166 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} Jun 08 22:52:34.047438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:34.047204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} Jun 08 22:52:35.054946 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:35.054914 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerStarted","Data":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} Jun 08 22:52:35.084079 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:35.084030 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.6921595160000003 podStartE2EDuration="7.084015242s" totalImagesPullingTime="3.371854591s" totalInitContainerRuntime="20.001135ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:52:35.081534585 +0000 UTC m=+297.638364425" watchObservedRunningTime="2026-06-08 22:52:35.084015242 +0000 UTC m=+297.640845082" Jun 08 22:52:36.011587 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:36.011559 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2mplf" Jun 08 22:52:37.843119 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:37.843093 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:52:37.843598 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:37.843516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:52:37.854489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:37.854466 2556 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 22:52:39.164875 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.164846 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/init-config-reloader/0.log" Jun 08 22:52:39.283491 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.283456 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:52:39.365597 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.365570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/alertmanager/0.log" Jun 08 22:52:39.564267 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.564235 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/config-reloader/0.log" Jun 08 22:52:39.764446 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.764394 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/kube-rbac-proxy-web/0.log" Jun 08 22:52:39.964966 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:39.964891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/kube-rbac-proxy/0.log" Jun 08 22:52:40.165229 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:40.165199 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/kube-rbac-proxy-metric/0.log" Jun 08 22:52:40.365005 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:40.364975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c557e252-0266-487a-9ca6-8b3223ce163e/prom-label-proxy/0.log" Jun 08 22:52:40.566064 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:40.566032 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-f6x2p_bcc3df8b-9214-4c1e-b7b9-932e754754fd/cluster-monitoring-operator/0.log" Jun 08 22:52:40.764804 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:40.764773 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-state-metrics/0.log" Jun 08 22:52:40.964302 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:40.964270 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-rbac-proxy-main/0.log" Jun 08 22:52:41.165061 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:41.164990 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-rbac-proxy-self/0.log" Jun 08 22:52:42.364801 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:42.364768 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/init-textfile/0.log" Jun 08 22:52:42.566137 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:42.566105 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/node-exporter/0.log" Jun 08 22:52:42.764371 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:42.764340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/kube-rbac-proxy/0.log" Jun 08 22:52:43.565143 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:43.565108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/kube-rbac-proxy-main/0.log" Jun 08 22:52:43.764599 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:43.764562 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/kube-rbac-proxy-self/0.log" Jun 08 22:52:43.964917 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:43.964840 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/openshift-state-metrics/0.log" Jun 08 22:52:44.164079 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:44.164054 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/init-config-reloader/0.log" Jun 08 22:52:44.365668 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:44.365642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/prometheus/0.log" Jun 08 22:52:44.564908 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:44.564878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/config-reloader/0.log" Jun 08 22:52:44.764226 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:44.764199 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/thanos-sidecar/0.log" Jun 08 22:52:44.964860 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:44.964831 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/kube-rbac-proxy-web/0.log" Jun 08 22:52:45.164981 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:45.164898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/kube-rbac-proxy/0.log" Jun 08 22:52:45.364375 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:45.364347 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a54c0ce1-69f3-428d-bc95-fc3e818c1f27/kube-rbac-proxy-thanos/0.log" Jun 08 22:52:45.965540 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:45.965508 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-r8n6n_29793c23-7a67-4735-8288-f5e6744f7117/prometheus-operator-admission-webhook/0.log" Jun 08 22:52:46.164188 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:46.164157 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/thanos-query/0.log" Jun 08 22:52:46.365012 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:46.364984 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-web/0.log" Jun 08 22:52:46.564834 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:46.564780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy/0.log" Jun 08 22:52:46.765606 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:46.765580 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/prom-label-proxy/0.log" Jun 08 22:52:46.964936 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:46.964895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-rules/0.log" Jun 08 22:52:47.164462 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:47.164373 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-metrics/0.log" Jun 08 22:52:47.365797 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:47.365756 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-zrwkp_be4a3613-f8da-4ef2-b12c-115d13503555/networking-console-plugin/0.log" Jun 08 22:52:47.565574 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:47.565539 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:52:47.766556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:47.766525 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/2.log" Jun 08 22:52:47.964763 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:47.964686 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-794bf8bf8b-6crjt_8fd180e9-55da-471e-a4c8-85fb6c419c00/console/0.log" Jun 08 22:52:48.566405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:48.566375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-k55kh_e6f6dca5-397c-4396-8a3f-9befaabd9b05/download-server/0.log" Jun 08 22:52:48.764797 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:48.764769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mplf_14499a9d-c2d1-43aa-866e-7ddef1a80ef9/dns/0.log" Jun 08 22:52:48.964882 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:48.964812 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mplf_14499a9d-c2d1-43aa-866e-7ddef1a80ef9/kube-rbac-proxy/0.log" Jun 08 22:52:50.164903 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:50.164878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-splbb_ef23a427-e719-4c05-bc76-fa0efd5c8f17/dns-node-resolver/0.log" Jun 08 22:52:51.565323 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:51.565280 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddz4r_2e1b96d2-ad5d-409b-9453-f23956fe864b/node-ca/0.log" Jun 08 22:52:52.364614 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:52.364590 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gdvwt_b6dc0d0a-6bed-4e3b-a018-711cbc4646fe/serve-healthcheck-canary/0.log" Jun 08 22:52:54.005901 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.005855 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-794bf8bf8b-6crjt" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" containerID="cri-o://048fd67e40b7f420bdcd253fce1d8387a585a917ed2a83356790977846a2b162" gracePeriod=15 Jun 08 22:52:54.141620 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.141589 2556 generic.go:356] "Generic (PLEG): container finished" podID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerID="048fd67e40b7f420bdcd253fce1d8387a585a917ed2a83356790977846a2b162" exitCode=0 Jun 08 22:52:54.141758 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.141665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794bf8bf8b-6crjt" event={"ID":"8fd180e9-55da-471e-a4c8-85fb6c419c00","Type":"ContainerDied","Data":"048fd67e40b7f420bdcd253fce1d8387a585a917ed2a83356790977846a2b162"} Jun 08 22:52:54.268882 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.268504 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:52:54.407686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407650 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6sbv\" (UniqueName: \"kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.407880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407721 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.407880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407751 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.407880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407788 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.407880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407808 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.407880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.407825 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config\") pod \"8fd180e9-55da-471e-a4c8-85fb6c419c00\" (UID: \"8fd180e9-55da-471e-a4c8-85fb6c419c00\") " Jun 08 22:52:54.408194 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.408160 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:52:54.408363 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.408335 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca" (OuterVolumeSpecName: "service-ca") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:52:54.408525 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.408394 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config" (OuterVolumeSpecName: "console-config") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:52:54.410337 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.410303 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv" (OuterVolumeSpecName: "kube-api-access-j6sbv") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "kube-api-access-j6sbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:52:54.410591 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.410563 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:52:54.410591 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.410578 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8fd180e9-55da-471e-a4c8-85fb6c419c00" (UID: "8fd180e9-55da-471e-a4c8-85fb6c419c00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:52:54.508794 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508763 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-service-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:54.508794 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508793 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-oauth-serving-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:54.508794 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508802 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:54.509008 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508812 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-serving-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:54.509008 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508822 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fd180e9-55da-471e-a4c8-85fb6c419c00-console-oauth-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:54.509008 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:54.508830 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6sbv\" (UniqueName: \"kubernetes.io/projected/8fd180e9-55da-471e-a4c8-85fb6c419c00-kube-api-access-j6sbv\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:52:55.153451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.149750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794bf8bf8b-6crjt" event={"ID":"8fd180e9-55da-471e-a4c8-85fb6c419c00","Type":"ContainerDied","Data":"07258b01701da0286132278cfb011cfabda335647ef8561c698c59a3b261ab4e"} Jun 08 22:52:55.153451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.149825 2556 scope.go:117] "RemoveContainer" containerID="048fd67e40b7f420bdcd253fce1d8387a585a917ed2a83356790977846a2b162" Jun 08 22:52:55.153451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.150030 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794bf8bf8b-6crjt" Jun 08 22:52:55.180306 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.180279 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:52:55.183073 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.183049 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794bf8bf8b-6crjt"] Jun 08 22:52:55.891038 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:52:55.891001 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" path="/var/lib/kubelet/pods/8fd180e9-55da-471e-a4c8-85fb6c419c00/volumes" Jun 08 22:53:29.282964 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:29.282876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:29.304383 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:29.304350 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:29.319287 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:29.319263 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:41.327488 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327443 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:41.327902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327756 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="alertmanager" containerID="cri-o://6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" gracePeriod=120 Jun 08 22:53:41.327902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327784 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-web" containerID="cri-o://a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" gracePeriod=120 Jun 08 22:53:41.327902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327781 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy" containerID="cri-o://3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" gracePeriod=120 Jun 08 22:53:41.327902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327804 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="prom-label-proxy" containerID="cri-o://a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" gracePeriod=120 Jun 08 22:53:41.327902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327825 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="config-reloader" containerID="cri-o://df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" gracePeriod=120 Jun 08 22:53:41.328155 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:41.327849 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-metric" containerID="cri-o://07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" gracePeriod=120 Jun 08 22:53:42.362838 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362807 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" exitCode=0 Jun 08 22:53:42.362838 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362833 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" exitCode=0 Jun 08 22:53:42.362838 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362841 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" exitCode=0 Jun 08 22:53:42.363271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362849 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" exitCode=0 Jun 08 22:53:42.363271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362878 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1"} Jun 08 22:53:42.363271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39"} Jun 08 22:53:42.363271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362970 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64"} Jun 08 22:53:42.363271 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.362996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b"} Jun 08 22:53:42.588437 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.588400 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:42.727163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727071 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727123 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727150 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727163 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727171 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727191 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727228 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmxqz\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727298 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727323 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727358 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727397 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727464 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.727942 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727624 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:42.727942 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.727835 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:53:42.728212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.728186 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:42.730301 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730050 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.730532 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730507 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz" (OuterVolumeSpecName: "kube-api-access-qmxqz") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "kube-api-access-qmxqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:53:42.730612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730512 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.730612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730536 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.730612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730549 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config\") pod \"c557e252-0266-487a-9ca6-8b3223ce163e\" (UID: \"c557e252-0266-487a-9ca6-8b3223ce163e\") " Jun 08 22:53:42.730612 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730540 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out" (OuterVolumeSpecName: "config-out") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:53:42.730841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730624 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume" (OuterVolumeSpecName: "config-volume") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.730841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730820 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-main-db\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.730841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730838 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmxqz\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-kube-api-access-qmxqz\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730853 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730869 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-metrics-client-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730881 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730896 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c557e252-0266-487a-9ca6-8b3223ce163e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730908 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-config-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730920 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c557e252-0266-487a-9ca6-8b3223ce163e-config-out\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730916 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:53:42.731006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.730932 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-main-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.732154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.732127 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.736824 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.736800 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.742105 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.742084 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config" (OuterVolumeSpecName: "web-config") pod "c557e252-0266-487a-9ca6-8b3223ce163e" (UID: "c557e252-0266-487a-9ca6-8b3223ce163e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:42.832105 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.832069 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-web-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.832105 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.832104 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.832105 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.832114 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c557e252-0266-487a-9ca6-8b3223ce163e-tls-assets\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:42.832272 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:42.832126 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c557e252-0266-487a-9ca6-8b3223ce163e-cluster-tls-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:43.370068 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370034 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" exitCode=0 Jun 08 22:53:43.370068 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370061 2556 generic.go:356] "Generic (PLEG): container finished" podID="c557e252-0266-487a-9ca6-8b3223ce163e" containerID="a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" exitCode=0 Jun 08 22:53:43.370528 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370093 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0"} Jun 08 22:53:43.370528 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370115 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.370528 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370179 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc"} Jun 08 22:53:43.370528 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370222 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c557e252-0266-487a-9ca6-8b3223ce163e","Type":"ContainerDied","Data":"c4e082e2ccf852c492da8ad6596fad414b1e0b4ae84ee5036d105c13938aa774"} Jun 08 22:53:43.370528 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.370244 2556 scope.go:117] "RemoveContainer" containerID="a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" Jun 08 22:53:43.378415 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.378399 2556 scope.go:117] "RemoveContainer" containerID="07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" Jun 08 22:53:43.388412 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.388387 2556 scope.go:117] "RemoveContainer" containerID="3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" Jun 08 22:53:43.396770 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.396747 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:43.397320 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.397298 2556 scope.go:117] "RemoveContainer" containerID="a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" Jun 08 22:53:43.403665 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.403642 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:43.405610 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.405596 2556 scope.go:117] "RemoveContainer" containerID="df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" Jun 08 22:53:43.412517 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.412499 2556 scope.go:117] "RemoveContainer" containerID="6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" Jun 08 22:53:43.420711 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.420693 2556 scope.go:117] "RemoveContainer" containerID="07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2" Jun 08 22:53:43.427037 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427017 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:43.427353 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427341 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-web" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427354 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-web" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427366 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="config-reloader" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427371 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="config-reloader" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427384 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="alertmanager" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427389 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="alertmanager" Jun 08 22:53:43.427399 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427400 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="init-config-reloader" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427405 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="init-config-reloader" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427413 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-metric" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427473 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-metric" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427493 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="prom-label-proxy" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427498 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="prom-label-proxy" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427505 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427511 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427517 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427522 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427573 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="config-reloader" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427580 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="alertmanager" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427587 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-metric" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427595 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd180e9-55da-471e-a4c8-85fb6c419c00" containerName="console" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427600 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy-web" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427606 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="kube-rbac-proxy" Jun 08 22:53:43.427657 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.427611 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" containerName="prom-label-proxy" Jun 08 22:53:43.431720 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.431701 2556 scope.go:117] "RemoveContainer" containerID="a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" Jun 08 22:53:43.431953 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.431928 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1\": container with ID starting with a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1 not found: ID does not exist" containerID="a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" Jun 08 22:53:43.432034 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.431966 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1"} err="failed to get container status \"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1\": rpc error: code = NotFound desc = could not find container \"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1\": container with ID starting with a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1 not found: ID does not exist" Jun 08 22:53:43.432034 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432010 2556 scope.go:117] "RemoveContainer" containerID="07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" Jun 08 22:53:43.432277 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.432261 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0\": container with ID starting with 07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0 not found: ID does not exist" containerID="07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" Jun 08 22:53:43.432322 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432281 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0"} err="failed to get container status \"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0\": rpc error: code = NotFound desc = could not find container \"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0\": container with ID starting with 07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0 not found: ID does not exist" Jun 08 22:53:43.432322 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432295 2556 scope.go:117] "RemoveContainer" containerID="3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" Jun 08 22:53:43.432565 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.432547 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39\": container with ID starting with 3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39 not found: ID does not exist" containerID="3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" Jun 08 22:53:43.432618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432570 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39"} err="failed to get container status \"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39\": rpc error: code = NotFound desc = could not find container \"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39\": container with ID starting with 3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39 not found: ID does not exist" Jun 08 22:53:43.432618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432585 2556 scope.go:117] "RemoveContainer" containerID="a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" Jun 08 22:53:43.432804 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.432787 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc\": container with ID starting with a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc not found: ID does not exist" containerID="a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" Jun 08 22:53:43.432844 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432809 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc"} err="failed to get container status \"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc\": rpc error: code = NotFound desc = could not find container \"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc\": container with ID starting with a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc not found: ID does not exist" Jun 08 22:53:43.432844 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432821 2556 scope.go:117] "RemoveContainer" containerID="df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" Jun 08 22:53:43.432993 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.432978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.433034 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.433004 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64\": container with ID starting with df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64 not found: ID does not exist" containerID="df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" Jun 08 22:53:43.433034 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433024 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64"} err="failed to get container status \"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64\": rpc error: code = NotFound desc = could not find container \"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64\": container with ID starting with df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64 not found: ID does not exist" Jun 08 22:53:43.433100 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433038 2556 scope.go:117] "RemoveContainer" containerID="6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" Jun 08 22:53:43.433337 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.433301 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b\": container with ID starting with 6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b not found: ID does not exist" containerID="6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" Jun 08 22:53:43.433441 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433335 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b"} err="failed to get container status \"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b\": rpc error: code = NotFound desc = could not find container \"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b\": container with ID starting with 6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b not found: ID does not exist" Jun 08 22:53:43.433441 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433356 2556 scope.go:117] "RemoveContainer" containerID="07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2" Jun 08 22:53:43.433637 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:43.433617 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2\": container with ID starting with 07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2 not found: ID does not exist" containerID="07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2" Jun 08 22:53:43.433708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433647 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2"} err="failed to get container status \"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2\": rpc error: code = NotFound desc = could not find container \"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2\": container with ID starting with 07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2 not found: ID does not exist" Jun 08 22:53:43.433708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433666 2556 scope.go:117] "RemoveContainer" containerID="a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1" Jun 08 22:53:43.433906 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433889 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1"} err="failed to get container status \"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1\": rpc error: code = NotFound desc = could not find container \"a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1\": container with ID starting with a50384754a986cd58de24d99f8762647ec9e78b823b006a314aae3dad80931c1 not found: ID does not exist" Jun 08 22:53:43.433967 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.433907 2556 scope.go:117] "RemoveContainer" containerID="07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0" Jun 08 22:53:43.434154 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434138 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0"} err="failed to get container status \"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0\": rpc error: code = NotFound desc = could not find container \"07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0\": container with ID starting with 07c1366cbb94610f5df6a031679b48165aa03f07102eb453e5e2b709ac10f7c0 not found: ID does not exist" Jun 08 22:53:43.434224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434154 2556 scope.go:117] "RemoveContainer" containerID="3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39" Jun 08 22:53:43.434361 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434345 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39"} err="failed to get container status \"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39\": rpc error: code = NotFound desc = could not find container \"3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39\": container with ID starting with 3c5bffbfff37361539558ad7204b9482eaf7b3d879efbc64e4b079a999304d39 not found: ID does not exist" Jun 08 22:53:43.434444 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434362 2556 scope.go:117] "RemoveContainer" containerID="a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc" Jun 08 22:53:43.434619 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434600 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc"} err="failed to get container status \"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc\": rpc error: code = NotFound desc = could not find container \"a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc\": container with ID starting with a579254a937473a143db330a7cadf9f8d48fc8706e90c59ebf3cc777493996cc not found: ID does not exist" Jun 08 22:53:43.434668 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434620 2556 scope.go:117] "RemoveContainer" containerID="df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64" Jun 08 22:53:43.434888 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434864 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64"} err="failed to get container status \"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64\": rpc error: code = NotFound desc = could not find container \"df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64\": container with ID starting with df3282f2d562d9365a9ddc4fd82fc0bff1640b14b8ff7e392bdb44b9111a6c64 not found: ID does not exist" Jun 08 22:53:43.434954 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.434890 2556 scope.go:117] "RemoveContainer" containerID="6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b" Jun 08 22:53:43.435124 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435106 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b"} err="failed to get container status \"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b\": rpc error: code = NotFound desc = could not find container \"6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b\": container with ID starting with 6eaa27c18e23c62cb9bd663df36b9e006aca50b6792badc7eb0e73804940362b not found: ID does not exist" Jun 08 22:53:43.435166 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435125 2556 scope.go:117] "RemoveContainer" containerID="07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2" Jun 08 22:53:43.435401 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435374 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2"} err="failed to get container status \"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2\": rpc error: code = NotFound desc = could not find container \"07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2\": container with ID starting with 07a86b0d353d65c5888d0196ac1d68283125c06a23f12aac7a1a6f0b0df789b2 not found: ID does not exist" Jun 08 22:53:43.435526 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435466 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 22:53:43.435585 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435538 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 22:53:43.435664 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435647 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 22:53:43.435729 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435712 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 22:53:43.435786 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435730 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 22:53:43.435786 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.435740 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 22:53:43.436095 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.436079 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7nbl\"" Jun 08 22:53:43.436170 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.436137 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 22:53:43.436228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.436170 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 22:53:43.439995 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.439897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 22:53:43.446310 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.446291 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:43.537521 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-web-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-config-out\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4sp\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-kube-api-access-xn4sp\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.537841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.537807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.638985 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.638918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.638985 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.638950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.638985 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.638970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4sp\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-kube-api-access-xn4sp\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639215 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.638988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639215 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639311 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639311 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639520 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-web-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639520 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639520 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639520 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639520 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.639781 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-config-out\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.640106 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.639981 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.640106 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.640074 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c87039b-6949-4f93-a943-e736511a4b24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642127 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.641993 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-config-out\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642127 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642080 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642135 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642410 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c87039b-6949-4f93-a943-e736511a4b24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642515 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642755 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642737 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-web-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.642825 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.643013 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.643013 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.642881 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.644060 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.644041 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c87039b-6949-4f93-a943-e736511a4b24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.646111 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.646094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4sp\" (UniqueName: \"kubernetes.io/projected/1c87039b-6949-4f93-a943-e736511a4b24-kube-api-access-xn4sp\") pod \"alertmanager-main-0\" (UID: \"1c87039b-6949-4f93-a943-e736511a4b24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.742203 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.742176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:53:43.878104 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.878080 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:53:43.880901 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:53:43.880870 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c87039b_6949_4f93_a943_e736511a4b24.slice/crio-6a6c2869706e1520271e2f1070bdd88fd80907c86252d0458bec8fa2d36bb901 WatchSource:0}: Error finding container 6a6c2869706e1520271e2f1070bdd88fd80907c86252d0458bec8fa2d36bb901: Status 404 returned error can't find the container with id 6a6c2869706e1520271e2f1070bdd88fd80907c86252d0458bec8fa2d36bb901 Jun 08 22:53:43.891068 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:43.890967 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c557e252-0266-487a-9ca6-8b3223ce163e" path="/var/lib/kubelet/pods/c557e252-0266-487a-9ca6-8b3223ce163e/volumes" Jun 08 22:53:44.375463 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:44.375412 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c87039b-6949-4f93-a943-e736511a4b24" containerID="7e4e87e8db166649f82893493c45367b1d0d576be226e7910f8e23076daec22d" exitCode=0 Jun 08 22:53:44.375932 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:44.375519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerDied","Data":"7e4e87e8db166649f82893493c45367b1d0d576be226e7910f8e23076daec22d"} Jun 08 22:53:44.375932 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:44.375610 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"6a6c2869706e1520271e2f1070bdd88fd80907c86252d0458bec8fa2d36bb901"} Jun 08 22:53:45.386953 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.386909 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"ffc25d77fa07656eb163c4939f96486953e7d1ca5627c7a73329be6916996743"} Jun 08 22:53:45.387438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.387042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"a3993caf503ee6844413b3f7935409146cb9c2724be1baae428535ddb8b67813"} Jun 08 22:53:45.387438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.387092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"2cb7dbec9e93b52c2ee6a5e7c54be4a67a78f49b507eb0d2de8866ccf8383fe3"} Jun 08 22:53:45.387438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.387140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"da022048911611b8b4261b911b728efe7f95e725e30c4c0679563cbfd0279e84"} Jun 08 22:53:45.387438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.387204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"b39073015f3b6c8c4e048105a91f74ec8af124be15848d375ecf0d5111a77926"} Jun 08 22:53:45.387438 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.387259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c87039b-6949-4f93-a943-e736511a4b24","Type":"ContainerStarted","Data":"65cb32c5eb508568789fe068dfd50701041f565339f14e84494b8c1e629dd2dd"} Jun 08 22:53:45.415902 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.415853 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.402258393 podStartE2EDuration="2.41583903s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.580637ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:53:45.413584188 +0000 UTC m=+367.970414047" watchObservedRunningTime="2026-06-08 22:53:45.41583903 +0000 UTC m=+367.972668870" Jun 08 22:53:45.645644 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645564 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:45.645903 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645851 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="prometheus" containerID="cri-o://95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" gracePeriod=600 Jun 08 22:53:45.645991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645900 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="config-reloader" containerID="cri-o://5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" gracePeriod=600 Jun 08 22:53:45.645991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645899 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="thanos-sidecar" containerID="cri-o://9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" gracePeriod=600 Jun 08 22:53:45.645991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645860 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy" containerID="cri-o://20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" gracePeriod=600 Jun 08 22:53:45.646141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645972 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" gracePeriod=600 Jun 08 22:53:45.646141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.645896 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-web" containerID="cri-o://f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" gracePeriod=600 Jun 08 22:53:45.884448 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.884410 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:45.962256 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962188 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962256 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962234 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962261 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962282 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962384 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962443 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962476 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962506 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962532 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962569 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962604 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962630 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962659 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962684 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvrrp\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.962731 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962726 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962778 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962817 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962850 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962873 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962808 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962910 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config\") pod \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\" (UID: \"a54c0ce1-69f3-428d-bc95-fc3e818c1f27\") " Jun 08 22:53:45.963112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.962937 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.963556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.963190 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:45.963556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.963211 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:45.963556 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.963229 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:45.964488 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.964457 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.964945 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.964915 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.965036 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.964978 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.965618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.965304 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out" (OuterVolumeSpecName: "config-out") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:53:45.965618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.965552 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.965618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.965571 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config" (OuterVolumeSpecName: "config") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.966143 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.966114 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.966230 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.966120 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.966541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.966507 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.966541 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.966513 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:53:45.966977 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.966956 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.967242 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.967216 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:53:45.967621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.967586 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:53:45.967706 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.967621 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.967706 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.967671 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp" (OuterVolumeSpecName: "kube-api-access-hvrrp") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "kube-api-access-hvrrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:53:45.968512 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.968489 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:45.976799 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:45.976781 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config" (OuterVolumeSpecName: "web-config") pod "a54c0ce1-69f3-428d-bc95-fc3e818c1f27" (UID: "a54c0ce1-69f3-428d-bc95-fc3e818c1f27"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:53:46.063711 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063689 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config-out\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063711 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063709 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063719 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063728 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-tls-assets\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063736 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvrrp\" (UniqueName: \"kubernetes.io/projected/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-kube-api-access-hvrrp\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063745 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063753 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-kube-rbac-proxy\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063761 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063770 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-configmap-metrics-client-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063778 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-db\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063787 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-grpc-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063794 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063801 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-metrics-client-certs\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063809 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-web-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063817 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063824 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.063833 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.063834 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54c0ce1-69f3-428d-bc95-fc3e818c1f27-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:53:46.394005 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.393962 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" exitCode=0 Jun 08 22:53:46.394005 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.393993 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" exitCode=0 Jun 08 22:53:46.394005 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394003 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" exitCode=0 Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394013 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" exitCode=0 Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394021 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" exitCode=0 Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394030 2556 generic.go:356] "Generic (PLEG): container finished" podID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" exitCode=0 Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394055 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394165 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394189 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394187 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} Jun 08 22:53:46.394486 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.394237 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54c0ce1-69f3-428d-bc95-fc3e818c1f27","Type":"ContainerDied","Data":"7f450274c8eb7a044c03b1fa43bfe14c933a2ec19f2adcd118fe48b46aa107ba"} Jun 08 22:53:46.403686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.403664 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.411653 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.411629 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.418708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.418672 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.420841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.420820 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:46.425723 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.425699 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:46.440489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.440472 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.447607 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.447588 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.449071 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449053 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:46.449369 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449358 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-thanos" Jun 08 22:53:46.449408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449370 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-thanos" Jun 08 22:53:46.449408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449383 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="prometheus" Jun 08 22:53:46.449408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449389 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="prometheus" Jun 08 22:53:46.449408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449397 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="init-config-reloader" Jun 08 22:53:46.449408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449403 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="init-config-reloader" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449414 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-web" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449435 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-web" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449446 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="thanos-sidecar" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449454 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="thanos-sidecar" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449464 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="config-reloader" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449469 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="config-reloader" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449475 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449480 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449534 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449543 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-web" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449550 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="thanos-sidecar" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449556 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="prometheus" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449561 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="kube-rbac-proxy-thanos" Jun 08 22:53:46.449578 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.449566 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" containerName="config-reloader" Jun 08 22:53:46.454681 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.454665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.455514 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.455491 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.457385 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457358 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 22:53:46.457571 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 22:53:46.457691 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 22:53:46.457810 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457782 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4fzrt\"" Jun 08 22:53:46.457810 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457798 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 22:53:46.457921 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457832 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 22:53:46.457921 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457891 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 22:53:46.458022 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.457942 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 22:53:46.458229 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458195 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 22:53:46.458356 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 22:53:46.458356 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458313 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 22:53:46.458570 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458358 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 22:53:46.458808 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458789 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 22:53:46.458899 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458814 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-954mpn23oepph\"" Jun 08 22:53:46.458899 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.458858 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 22:53:46.461006 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.460988 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 22:53:46.464113 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.463954 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.464405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.464382 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 22:53:46.464628 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.464585 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.465145 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.464620 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.465240 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.465152 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.466337 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.466310 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.466529 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.466347 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.466529 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.466370 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.470313 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.468904 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:46.472441 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.472388 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.472543 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.472447 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.472543 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.472471 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.472807 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.472783 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.472905 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.472814 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.472905 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.472833 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.473124 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.473095 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.473170 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473134 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.473170 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473155 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.473464 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.473441 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.473565 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473465 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.473565 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473478 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.473705 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:53:46.473680 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.473767 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473706 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.473767 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473718 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.473969 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473947 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.474033 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.473970 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.474194 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474177 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.474194 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474193 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.474401 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474385 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.474401 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474398 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.474621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474602 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.474621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474619 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.474829 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474810 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.474897 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.474830 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.475100 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475084 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.475100 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475099 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.475286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475266 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.475286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475285 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.475505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475478 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.475505 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475503 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.475710 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475693 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.475710 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475708 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.475897 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475877 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.475897 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.475897 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.476115 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476097 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.476115 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476114 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.476314 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476298 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.476314 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476314 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.476515 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476496 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.476515 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476513 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.476716 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476700 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.476776 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476715 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.476906 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476890 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.476906 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.476904 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.477092 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477073 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.477153 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477092 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.477334 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477315 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.477405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477334 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.477577 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477557 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.477577 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477576 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.477799 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477783 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.477799 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477797 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.478002 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.477986 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.478002 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478000 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.478208 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478186 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.478208 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478208 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.478413 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478394 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.478413 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478414 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.478629 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478611 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.478629 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478628 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.478842 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478824 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.478894 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.478843 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.479032 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479015 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.479032 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479031 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.479235 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479217 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.479277 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479235 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.479451 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479408 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.479537 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479454 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.479717 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479699 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.479768 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479718 2556 scope.go:117] "RemoveContainer" containerID="1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2" Jun 08 22:53:46.479959 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479942 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2"} err="failed to get container status \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": rpc error: code = NotFound desc = could not find container \"1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2\": container with ID starting with 1f3551233611c1f6163f9aa16693df6794f4be4a114daf7c38881feaaf7f82a2 not found: ID does not exist" Jun 08 22:53:46.479959 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.479958 2556 scope.go:117] "RemoveContainer" containerID="20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101" Jun 08 22:53:46.480193 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480170 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101"} err="failed to get container status \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": rpc error: code = NotFound desc = could not find container \"20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101\": container with ID starting with 20e1f19a94c42490d93be6b0f1cbd1e201abdb7d68976ece77d97080097d2101 not found: ID does not exist" Jun 08 22:53:46.480261 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480195 2556 scope.go:117] "RemoveContainer" containerID="f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63" Jun 08 22:53:46.480431 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480397 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63"} err="failed to get container status \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": rpc error: code = NotFound desc = could not find container \"f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63\": container with ID starting with f202dd062064fea86a07e6470952ef9ac94cd98a37b552a25da54c1c72c33d63 not found: ID does not exist" Jun 08 22:53:46.480500 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480443 2556 scope.go:117] "RemoveContainer" containerID="9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb" Jun 08 22:53:46.480679 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480662 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb"} err="failed to get container status \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": rpc error: code = NotFound desc = could not find container \"9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb\": container with ID starting with 9a87ff7ac18625c456e3df32935b943088af7e376afb6f5fc06d442af766cdfb not found: ID does not exist" Jun 08 22:53:46.480720 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480680 2556 scope.go:117] "RemoveContainer" containerID="5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d" Jun 08 22:53:46.480889 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480869 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d"} err="failed to get container status \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": rpc error: code = NotFound desc = could not find container \"5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d\": container with ID starting with 5e5591c603d34384b73877fb1eb9ef6f9075930cc21cf4a173da1f892394429d not found: ID does not exist" Jun 08 22:53:46.480930 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.480889 2556 scope.go:117] "RemoveContainer" containerID="95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b" Jun 08 22:53:46.481102 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.481081 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b"} err="failed to get container status \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": rpc error: code = NotFound desc = could not find container \"95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b\": container with ID starting with 95d7896cb245ffc7dfdd614697d477bd36f800c319210933b86208dd807b4f0b not found: ID does not exist" Jun 08 22:53:46.481143 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.481103 2556 scope.go:117] "RemoveContainer" containerID="bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5" Jun 08 22:53:46.481321 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.481305 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5"} err="failed to get container status \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": rpc error: code = NotFound desc = could not find container \"bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5\": container with ID starting with bfe5c4eb4130d5d59b1ef2ca1a0501193460b4073997c2c1700757f646664ac5 not found: ID does not exist" Jun 08 22:53:46.567663 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.567663 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.567843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.567843 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.567931 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.567981 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.567997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568074 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568120 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568157 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568198 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568165 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568231 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568300 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568367 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568415 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568492 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568650 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmc7z\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-kube-api-access-lmc7z\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568709 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568758 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.568758 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.568730 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669569 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669569 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669569 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669554 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669735 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.669774 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.669980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670141 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.670012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmc7z\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-kube-api-access-lmc7z\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.670686 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.670238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.671010 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.670982 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.672069 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.672536 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672514 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.672662 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672622 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.672744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.672880 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673080 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.672985 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673080 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673053 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673307 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673453 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673401 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673589 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673589 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.673899 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.673855 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.674581 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.674562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.675454 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.675413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.675680 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.675661 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.675889 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.675874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.676872 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.676848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.678003 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.677988 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmc7z\" (UniqueName: \"kubernetes.io/projected/b4cc6625-6ff5-4d46-ac26-75ae4c9ad080-kube-api-access-lmc7z\") pod \"prometheus-k8s-0\" (UID: \"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.767187 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.767151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:53:46.901995 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:46.901970 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:53:46.903956 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:53:46.903933 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cc6625_6ff5_4d46_ac26_75ae4c9ad080.slice/crio-d08d503487c27dc65f23dca8fe1823734924b4fce4dbdc3cec34091e42e69940 WatchSource:0}: Error finding container d08d503487c27dc65f23dca8fe1823734924b4fce4dbdc3cec34091e42e69940: Status 404 returned error can't find the container with id d08d503487c27dc65f23dca8fe1823734924b4fce4dbdc3cec34091e42e69940 Jun 08 22:53:47.400809 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:47.400774 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4cc6625-6ff5-4d46-ac26-75ae4c9ad080" containerID="e5941110c2ee0c20cb6b7b3a8e2db1f9feda28113661a8f92f9440693fa3f1d2" exitCode=0 Jun 08 22:53:47.401285 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:47.400860 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerDied","Data":"e5941110c2ee0c20cb6b7b3a8e2db1f9feda28113661a8f92f9440693fa3f1d2"} Jun 08 22:53:47.401285 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:47.400930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"d08d503487c27dc65f23dca8fe1823734924b4fce4dbdc3cec34091e42e69940"} Jun 08 22:53:47.891285 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:47.891257 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54c0ce1-69f3-428d-bc95-fc3e818c1f27" path="/var/lib/kubelet/pods/a54c0ce1-69f3-428d-bc95-fc3e818c1f27/volumes" Jun 08 22:53:48.410507 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410476 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"37f849babf2f789a6f29b3bfd0b1100b11a5e4c81a46a6bcb2e374a54c0a0526"} Jun 08 22:53:48.410873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"26e5d984ddef6438455157ef1b4de00738ee1de5f254044901e995a951659362"} Jun 08 22:53:48.410873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410571 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"264bef66cfb6944fc5c3ca3d80aab485ea1cba15b6a33c9e1ff7e8a4b0a80d59"} Jun 08 22:53:48.410873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"8f8486c2ae6bd5aa0412117c8aad3b35189c612f4cf3b91c901068314e12fecb"} Jun 08 22:53:48.410873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410618 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"e351e273e499626192e1708d71156c9b97cd84795a4b0f0a6a6e1ffdf88d1728"} Jun 08 22:53:48.410873 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.410645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4cc6625-6ff5-4d46-ac26-75ae4c9ad080","Type":"ContainerStarted","Data":"d5d9fad6f3aa2b8b818b21b098b0ff8973d4073c4cdba8c5580871a0cee271d1"} Jun 08 22:53:48.439254 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:48.439204 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.417367595 podStartE2EDuration="2.439190385s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.82279ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:53:48.436616866 +0000 UTC m=+370.993446705" watchObservedRunningTime="2026-06-08 22:53:48.439190385 +0000 UTC m=+370.996020224" Jun 08 22:53:51.767690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:53:51.767644 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:54:46.767852 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:54:46.767818 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:54:46.783568 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:54:46.783542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:54:47.690273 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:54:47.690245 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:56:31.876224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.876150 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s"] Jun 08 22:56:31.879678 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.879661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:31.882286 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.882267 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 22:56:31.882401 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.882268 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:56:31.883588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.883541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f8kf2\"" Jun 08 22:56:31.893809 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.893786 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s"] Jun 08 22:56:31.961773 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.961737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jj2\" (UniqueName: \"kubernetes.io/projected/849e268e-258c-4517-82a5-927ff8a91ba4-kube-api-access-44jj2\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:31.961948 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:31.961800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849e268e-258c-4517-82a5-927ff8a91ba4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.063227 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.063197 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849e268e-258c-4517-82a5-927ff8a91ba4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.063382 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.063256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44jj2\" (UniqueName: \"kubernetes.io/projected/849e268e-258c-4517-82a5-927ff8a91ba4-kube-api-access-44jj2\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.063663 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.063644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849e268e-258c-4517-82a5-927ff8a91ba4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.071883 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.071860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jj2\" (UniqueName: \"kubernetes.io/projected/849e268e-258c-4517-82a5-927ff8a91ba4-kube-api-access-44jj2\") pod \"openshift-lws-operator-fd8ccff4c-ndm6s\" (UID: \"849e268e-258c-4517-82a5-927ff8a91ba4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.206817 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.206748 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" Jun 08 22:56:32.334363 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.334332 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s"] Jun 08 22:56:32.337402 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:56:32.337376 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod849e268e_258c_4517_82a5_927ff8a91ba4.slice/crio-efc119f7266497b3c45bd03d63662cb765ff273c5595332f3ce1c56fccf8950c WatchSource:0}: Error finding container efc119f7266497b3c45bd03d63662cb765ff273c5595332f3ce1c56fccf8950c: Status 404 returned error can't find the container with id efc119f7266497b3c45bd03d63662cb765ff273c5595332f3ce1c56fccf8950c Jun 08 22:56:32.338871 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:32.338849 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:56:33.122391 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:33.122358 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" event={"ID":"849e268e-258c-4517-82a5-927ff8a91ba4","Type":"ContainerStarted","Data":"efc119f7266497b3c45bd03d63662cb765ff273c5595332f3ce1c56fccf8950c"} Jun 08 22:56:36.145319 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:36.145280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" event={"ID":"849e268e-258c-4517-82a5-927ff8a91ba4","Type":"ContainerStarted","Data":"345673994a667fb094968bb5d92880088dcef67fb05f329cda13426c79d79037"} Jun 08 22:56:36.161909 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:36.161855 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndm6s" podStartSLOduration=2.261444252 podStartE2EDuration="5.161839633s" totalImagesPullingTime="2.900395381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:56:36.159891852 +0000 UTC m=+538.716721717" watchObservedRunningTime="2026-06-08 22:56:36.161839633 +0000 UTC m=+538.718669472" Jun 08 22:56:55.455653 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.455618 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn"] Jun 08 22:56:55.459070 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.459053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.464228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.462086 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 22:56:55.464228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.462174 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 22:56:55.464228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.462573 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 22:56:55.464228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.462758 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 22:56:55.464228 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.462837 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7hrnz\"" Jun 08 22:56:55.473183 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.473143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn"] Jun 08 22:56:55.564582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.564551 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.564747 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.564613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-manifests\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.564747 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.564685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-tmp\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.564747 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.564736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.564852 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.564754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrzd\" (UniqueName: \"kubernetes.io/projected/bfff357d-47ff-4525-8a1c-4cd6fe967047-kube-api-access-mvrzd\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.665808 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.665768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-manifests\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.665979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.665822 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-tmp\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.665979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.665848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.665979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.665862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrzd\" (UniqueName: \"kubernetes.io/projected/bfff357d-47ff-4525-8a1c-4cd6fe967047-kube-api-access-mvrzd\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.665979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.665879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.666259 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.666238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-manifests\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.668252 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.668227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfff357d-47ff-4525-8a1c-4cd6fe967047-tmp\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.668370 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.668343 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.668480 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.668463 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfff357d-47ff-4525-8a1c-4cd6fe967047-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.678071 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.678047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrzd\" (UniqueName: \"kubernetes.io/projected/bfff357d-47ff-4525-8a1c-4cd6fe967047-kube-api-access-mvrzd\") pod \"opendatahub-operator-controller-manager-56cdd97b9c-p4ttn\" (UID: \"bfff357d-47ff-4525-8a1c-4cd6fe967047\") " pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.777092 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.777065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:56:55.912642 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:55.912601 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn"] Jun 08 22:56:56.233858 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:56.233783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" event={"ID":"bfff357d-47ff-4525-8a1c-4cd6fe967047","Type":"ContainerStarted","Data":"58f200170f08c3939516e436081908f811cab506864498e910827f51e99d49d8"} Jun 08 22:56:59.251851 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:56:59.251817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" event={"ID":"bfff357d-47ff-4525-8a1c-4cd6fe967047","Type":"ContainerStarted","Data":"5283d2cf12919e8c4f0f696159b2308cae888eaf32d736254c42975f0966268d"} Jun 08 22:57:00.258498 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:00.258462 2556 generic.go:356] "Generic (PLEG): container finished" podID="bfff357d-47ff-4525-8a1c-4cd6fe967047" containerID="5283d2cf12919e8c4f0f696159b2308cae888eaf32d736254c42975f0966268d" exitCode=0 Jun 08 22:57:00.258909 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:00.258554 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" event={"ID":"bfff357d-47ff-4525-8a1c-4cd6fe967047","Type":"ContainerDied","Data":"5283d2cf12919e8c4f0f696159b2308cae888eaf32d736254c42975f0966268d"} Jun 08 22:57:01.265476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:01.265439 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" event={"ID":"bfff357d-47ff-4525-8a1c-4cd6fe967047","Type":"ContainerStarted","Data":"0f194035aeaf5ff776d64ad5b63b1eda1b8848afa9dfae01b68cbf08f7a6e585"} Jun 08 22:57:01.265882 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:01.265536 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:57:01.287497 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:01.287438 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" podStartSLOduration=1.982487238 podStartE2EDuration="6.287409924s" totalImagesPullingTime="3.260575407s" totalInitContainerRuntime="1.044347279s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:56:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:57:01.285253884 +0000 UTC m=+563.842083725" watchObservedRunningTime="2026-06-08 22:57:01.287409924 +0000 UTC m=+563.844239764" Jun 08 22:57:12.272792 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:12.272761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56cdd97b9c-p4ttn" Jun 08 22:57:13.059385 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.059350 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw"] Jun 08 22:57:13.067099 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.067078 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.071713 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.071687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 22:57:13.071950 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.071743 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 22:57:13.071950 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.071772 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ngwhf\"" Jun 08 22:57:13.072109 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.071828 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 22:57:13.074842 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.074433 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw"] Jun 08 22:57:13.117546 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.117515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e78c0236-1a66-4cc3-a80b-14dc489833dc-manager-config\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.117546 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.117544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-metrics-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.117702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.117572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.117702 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.117597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmm55\" (UniqueName: \"kubernetes.io/projected/e78c0236-1a66-4cc3-a80b-14dc489833dc-kube-api-access-hmm55\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.218741 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.218714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e78c0236-1a66-4cc3-a80b-14dc489833dc-manager-config\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.218741 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.218740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-metrics-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.218942 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.218764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.218942 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.218785 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmm55\" (UniqueName: \"kubernetes.io/projected/e78c0236-1a66-4cc3-a80b-14dc489833dc-kube-api-access-hmm55\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.219439 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.219405 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e78c0236-1a66-4cc3-a80b-14dc489833dc-manager-config\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.221229 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.221208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-metrics-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.221324 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.221293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e78c0236-1a66-4cc3-a80b-14dc489833dc-cert\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.234638 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.234612 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmm55\" (UniqueName: \"kubernetes.io/projected/e78c0236-1a66-4cc3-a80b-14dc489833dc-kube-api-access-hmm55\") pod \"lws-controller-manager-667ddfcf76-ms4tw\" (UID: \"e78c0236-1a66-4cc3-a80b-14dc489833dc\") " pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.377294 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.377214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:13.510119 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:13.510093 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw"] Jun 08 22:57:13.512239 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:57:13.512205 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78c0236_1a66_4cc3_a80b_14dc489833dc.slice/crio-7c4a7f9eecba5c1bb643d4c516a63385c0e4bd2ad716837b8f575a44f6679311 WatchSource:0}: Error finding container 7c4a7f9eecba5c1bb643d4c516a63385c0e4bd2ad716837b8f575a44f6679311: Status 404 returned error can't find the container with id 7c4a7f9eecba5c1bb643d4c516a63385c0e4bd2ad716837b8f575a44f6679311 Jun 08 22:57:14.327224 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.327186 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" event={"ID":"e78c0236-1a66-4cc3-a80b-14dc489833dc","Type":"ContainerStarted","Data":"7c4a7f9eecba5c1bb643d4c516a63385c0e4bd2ad716837b8f575a44f6679311"} Jun 08 22:57:14.460847 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.460811 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85448bb448-fkgqn"] Jun 08 22:57:14.467245 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.467217 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.470991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.470747 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 22:57:14.470991 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.470761 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 22:57:14.472615 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.472391 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4vv9r\"" Jun 08 22:57:14.472615 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.472443 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 22:57:14.472615 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.472505 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 22:57:14.481240 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.481215 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85448bb448-fkgqn"] Jun 08 22:57:14.534062 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.534025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e51a766-98e9-4522-aa21-d41b380ec042-tmp\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.534254 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.534130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgn7\" (UniqueName: \"kubernetes.io/projected/7e51a766-98e9-4522-aa21-d41b380ec042-kube-api-access-fkgn7\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.534254 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.534168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e51a766-98e9-4522-aa21-d41b380ec042-tls-certs\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.635096 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.634859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgn7\" (UniqueName: \"kubernetes.io/projected/7e51a766-98e9-4522-aa21-d41b380ec042-kube-api-access-fkgn7\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.635096 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.634929 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e51a766-98e9-4522-aa21-d41b380ec042-tls-certs\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.635096 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.635025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e51a766-98e9-4522-aa21-d41b380ec042-tmp\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.637673 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.637644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e51a766-98e9-4522-aa21-d41b380ec042-tmp\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.638106 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.638082 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e51a766-98e9-4522-aa21-d41b380ec042-tls-certs\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.645494 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.645474 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgn7\" (UniqueName: \"kubernetes.io/projected/7e51a766-98e9-4522-aa21-d41b380ec042-kube-api-access-fkgn7\") pod \"kube-auth-proxy-85448bb448-fkgqn\" (UID: \"7e51a766-98e9-4522-aa21-d41b380ec042\") " pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.785325 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.785290 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" Jun 08 22:57:14.956802 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:14.956760 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85448bb448-fkgqn"] Jun 08 22:57:15.226125 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:57:15.226039 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e51a766_98e9_4522_aa21_d41b380ec042.slice/crio-3c030ec08bf1302126dde1655322fe108162f4ffef50360befdd8f68b3f58004 WatchSource:0}: Error finding container 3c030ec08bf1302126dde1655322fe108162f4ffef50360befdd8f68b3f58004: Status 404 returned error can't find the container with id 3c030ec08bf1302126dde1655322fe108162f4ffef50360befdd8f68b3f58004 Jun 08 22:57:15.333170 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:15.333140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" event={"ID":"7e51a766-98e9-4522-aa21-d41b380ec042","Type":"ContainerStarted","Data":"3c030ec08bf1302126dde1655322fe108162f4ffef50360befdd8f68b3f58004"} Jun 08 22:57:16.339730 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:16.339690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" event={"ID":"e78c0236-1a66-4cc3-a80b-14dc489833dc","Type":"ContainerStarted","Data":"818074d93230e88f1ef580a75a77b574f881c1aea7c3ca79f74b909da48d33cb"} Jun 08 22:57:16.340171 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:16.339807 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:16.355588 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:16.355535 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" podStartSLOduration=1.586746695 podStartE2EDuration="3.355521146s" totalImagesPullingTime="1.768774451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:57:16.354062663 +0000 UTC m=+578.910892503" watchObservedRunningTime="2026-06-08 22:57:16.355521146 +0000 UTC m=+578.912350987" Jun 08 22:57:18.351962 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:18.351916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" event={"ID":"7e51a766-98e9-4522-aa21-d41b380ec042","Type":"ContainerStarted","Data":"550fa8ad0ce9ed77e0831e2190b67ec8ce0f13ceedf2b6104cecc03bf36adc8f"} Jun 08 22:57:18.367649 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:18.367599 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85448bb448-fkgqn" podStartSLOduration=1.673069569 podStartE2EDuration="4.367584015s" totalImagesPullingTime="2.694514446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:57:18.366173108 +0000 UTC m=+580.923002974" watchObservedRunningTime="2026-06-08 22:57:18.367584015 +0000 UTC m=+580.924413912" Jun 08 22:57:27.348670 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:27.348638 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-667ddfcf76-ms4tw" Jun 08 22:57:37.885683 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:37.885652 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:57:37.886727 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:57:37.886699 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 22:58:51.062640 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.062603 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-968dc64dd-9pkpd"] Jun 08 22:58:51.066719 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.066693 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.070910 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.070472 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 22:58:51.070910 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.069672 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 22:58:51.071832 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.071261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 22:58:51.071832 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.071708 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 22:58:51.072014 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.071962 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 22:58:51.072014 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.071980 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l2wd6\"" Jun 08 22:58:51.081040 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.081013 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 22:58:51.083402 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.083377 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-968dc64dd-9pkpd"] Jun 08 22:58:51.224237 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z99tv\" (UniqueName: \"kubernetes.io/projected/f0bccdbb-747b-4aa4-8628-769acb7f994f-kube-api-access-z99tv\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-oauth-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-service-ca\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224476 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-oauth-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.224690 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.224492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-trusted-ca-bundle\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325601 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z99tv\" (UniqueName: \"kubernetes.io/projected/f0bccdbb-747b-4aa4-8628-769acb7f994f-kube-api-access-z99tv\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325601 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325563 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325601 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-oauth-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325840 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-service-ca\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325840 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325840 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-oauth-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.325840 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.325745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-trusted-ca-bundle\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.326333 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.326304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-oauth-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.326489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.326304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.326489 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.326411 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-service-ca\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.326658 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.326640 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0bccdbb-747b-4aa4-8628-769acb7f994f-trusted-ca-bundle\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.328265 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.328238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-serving-cert\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.328358 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.328272 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0bccdbb-747b-4aa4-8628-769acb7f994f-console-oauth-config\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.337933 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.337909 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z99tv\" (UniqueName: \"kubernetes.io/projected/f0bccdbb-747b-4aa4-8628-769acb7f994f-kube-api-access-z99tv\") pod \"console-968dc64dd-9pkpd\" (UID: \"f0bccdbb-747b-4aa4-8628-769acb7f994f\") " pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.380823 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.380789 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:58:51.516405 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.516377 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-968dc64dd-9pkpd"] Jun 08 22:58:51.796591 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.796556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968dc64dd-9pkpd" event={"ID":"f0bccdbb-747b-4aa4-8628-769acb7f994f","Type":"ContainerStarted","Data":"683317cee726b19990b8cf3271dfdc503da66312dfab8a4404dc3dce55b5135c"} Jun 08 22:58:51.796775 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.796614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968dc64dd-9pkpd" event={"ID":"f0bccdbb-747b-4aa4-8628-769acb7f994f","Type":"ContainerStarted","Data":"989dedad080486950baf2c4c8ac9b531450662057efeb58df8a7ba49bfc9131f"} Jun 08 22:58:51.820437 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:51.820374 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-968dc64dd-9pkpd" podStartSLOduration=0.820357795 podStartE2EDuration="820.357795ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:58:51.81925775 +0000 UTC m=+674.376087590" watchObservedRunningTime="2026-06-08 22:58:51.820357795 +0000 UTC m=+674.377187634" Jun 08 22:58:59.390518 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.390486 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr"] Jun 08 22:58:59.393914 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.393897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.396712 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.396689 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 22:58:59.396836 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.396776 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w7kt9\"" Jun 08 22:58:59.396929 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.396915 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 22:58:59.407513 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.407462 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr"] Jun 08 22:58:59.499559 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.499521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7z4\" (UniqueName: \"kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.499726 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.499569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.600408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.600373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7z4\" (UniqueName: \"kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.600573 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.600445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.600866 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.600847 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.610599 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.610573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7z4\" (UniqueName: \"kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.705178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.705085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:58:59.845130 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:58:59.845107 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr"] Jun 08 22:58:59.848129 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:58:59.848095 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406b614c_8a06_4ef8_85cc_4de0e625a411.slice/crio-784da79180ef0f63d8aabdf2e0bae93555e184c3d70ba101aa5e114721d2dc4b WatchSource:0}: Error finding container 784da79180ef0f63d8aabdf2e0bae93555e184c3d70ba101aa5e114721d2dc4b: Status 404 returned error can't find the container with id 784da79180ef0f63d8aabdf2e0bae93555e184c3d70ba101aa5e114721d2dc4b Jun 08 22:59:00.842772 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:00.842739 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" event={"ID":"406b614c-8a06-4ef8-85cc-4de0e625a411","Type":"ContainerStarted","Data":"784da79180ef0f63d8aabdf2e0bae93555e184c3d70ba101aa5e114721d2dc4b"} Jun 08 22:59:01.381834 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:01.381786 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:59:01.382053 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:01.381858 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:59:01.386940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:01.386912 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:59:01.851986 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:01.851957 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-968dc64dd-9pkpd" Jun 08 22:59:07.884308 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:07.884267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" event={"ID":"406b614c-8a06-4ef8-85cc-4de0e625a411","Type":"ContainerStarted","Data":"659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c"} Jun 08 22:59:07.884707 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:07.884409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:07.905233 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:07.905185 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" podStartSLOduration=1.807373039 podStartE2EDuration="8.905171122s" totalImagesPullingTime="7.097798083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:59:07.902051175 +0000 UTC m=+690.458881014" watchObservedRunningTime="2026-06-08 22:59:07.905171122 +0000 UTC m=+690.462000961" Jun 08 22:59:18.891940 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:18.891911 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:19.771609 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.771575 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5"] Jun 08 22:59:19.775336 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.775307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:19.788133 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.788111 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5"] Jun 08 22:59:19.895816 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.895787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:19.896402 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.895839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k9hc\" (UniqueName: \"kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:19.997309 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.997275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:19.997510 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.997327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k9hc\" (UniqueName: \"kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:19.997696 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:19.997675 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:20.013852 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.013828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k9hc\" (UniqueName: \"kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:20.085748 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.085655 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:20.226010 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.225983 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5"] Jun 08 22:59:20.228546 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:59:20.228518 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56327582_ac6e_42cd_bfca_1c3c9769119a.slice/crio-47bd4a02ff417b668707ed32d2893a02fff4e9cc9c0b667a2ed0b8f0dd36807d WatchSource:0}: Error finding container 47bd4a02ff417b668707ed32d2893a02fff4e9cc9c0b667a2ed0b8f0dd36807d: Status 404 returned error can't find the container with id 47bd4a02ff417b668707ed32d2893a02fff4e9cc9c0b667a2ed0b8f0dd36807d Jun 08 22:59:20.497032 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.497001 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5"] Jun 08 22:59:20.505900 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.505865 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5"] Jun 08 22:59:20.513348 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.513322 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr"] Jun 08 22:59:20.513549 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.513522 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" containerName="manager" containerID="cri-o://659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c" gracePeriod=2 Jun 08 22:59:20.516680 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.516653 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:20.517178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.517157 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" containerName="manager" Jun 08 22:59:20.517178 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.517180 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" containerName="manager" Jun 08 22:59:20.517437 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.517278 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" containerName="manager" Jun 08 22:59:20.528969 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.528933 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.532816 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.532791 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr"] Jun 08 22:59:20.533153 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.533110 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"406b614c-8a06-4ef8-85cc-4de0e625a411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.535991 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.535898 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.538845 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.538820 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:20.540521 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.540497 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:20.540869 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.540857 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" containerName="manager" Jun 08 22:59:20.540930 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.540870 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" containerName="manager" Jun 08 22:59:20.540979 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.540951 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" containerName="manager" Jun 08 22:59:20.544054 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.544035 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.555590 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.555567 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:20.561617 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.561580 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.601693 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.601668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.601831 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.601701 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.601831 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.601753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qbw\" (UniqueName: \"kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.601831 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.601797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpz7\" (UniqueName: \"kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.703075 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qbw\" (UniqueName: \"kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.703212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpz7\" (UniqueName: \"kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.703212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.703212 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.703582 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703559 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.703674 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.703628 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.711990 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.711956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qbw\" (UniqueName: \"kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5kwg5\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.712128 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.712012 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpz7\" (UniqueName: \"kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hvbc8\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.747910 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.747856 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.750437 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.750390 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.804225 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.804192 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x7z4\" (UniqueName: \"kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4\") pod \"406b614c-8a06-4ef8-85cc-4de0e625a411\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " Jun 08 22:59:20.804225 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.804226 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume\") pod \"406b614c-8a06-4ef8-85cc-4de0e625a411\" (UID: \"406b614c-8a06-4ef8-85cc-4de0e625a411\") " Jun 08 22:59:20.804734 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.804711 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "406b614c-8a06-4ef8-85cc-4de0e625a411" (UID: "406b614c-8a06-4ef8-85cc-4de0e625a411"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:59:20.806442 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.806396 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4" (OuterVolumeSpecName: "kube-api-access-2x7z4") pod "406b614c-8a06-4ef8-85cc-4de0e625a411" (UID: "406b614c-8a06-4ef8-85cc-4de0e625a411"). InnerVolumeSpecName "kube-api-access-2x7z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:59:20.884805 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.884775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:20.892238 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.892213 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:20.905703 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.905676 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x7z4\" (UniqueName: \"kubernetes.io/projected/406b614c-8a06-4ef8-85cc-4de0e625a411-kube-api-access-2x7z4\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:20.905998 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.905710 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/406b614c-8a06-4ef8-85cc-4de0e625a411-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:20.955174 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.953662 2556 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" container="manager" Jun 08 22:59:20.957101 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.956886 2556 generic.go:356] "Generic (PLEG): container finished" podID="406b614c-8a06-4ef8-85cc-4de0e625a411" containerID="659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c" exitCode=0 Jun 08 22:59:20.957101 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.956988 2556 scope.go:117] "RemoveContainer" containerID="659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c" Jun 08 22:59:20.957101 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.956987 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:20.957668 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.957156 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.959265 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.959231 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.961356 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.961329 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:20.963468 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.963396 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.968039 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.968010 2556 scope.go:117] "RemoveContainer" containerID="659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c" Jun 08 22:59:20.968742 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.968717 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c\": container with ID starting with 659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c not found: ID does not exist" containerID="659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c" Jun 08 22:59:20.968847 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:20.968755 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c"} err="failed to get container status \"659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c\": rpc error: code = NotFound desc = could not find container \"659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c\": container with ID starting with 659e640c09bb408e073d63722fc236081cf06c6fc24b92aaaec1da1ae199682c not found: ID does not exist" Jun 08 22:59:20.971288 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.971262 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvpbr\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvpbr" Jun 08 22:59:20.973331 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:20.973302 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:21.045479 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.045453 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:21.047655 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:59:21.047629 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00f93e0_e75d_4974_8059_872ff2f54e1d.slice/crio-4aed56a20f2666eaa2b74c478dd945593876454c43bd91e42e18e7878d79e724 WatchSource:0}: Error finding container 4aed56a20f2666eaa2b74c478dd945593876454c43bd91e42e18e7878d79e724: Status 404 returned error can't find the container with id 4aed56a20f2666eaa2b74c478dd945593876454c43bd91e42e18e7878d79e724 Jun 08 22:59:21.055079 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.054527 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:21.057196 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:59:21.057175 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf880ac_65b8_41d9_a4c6_7ea479deb4fc.slice/crio-71b2e99ff97d17c66a946811735629e37380003100d7522e01f4b0a522710083 WatchSource:0}: Error finding container 71b2e99ff97d17c66a946811735629e37380003100d7522e01f4b0a522710083: Status 404 returned error can't find the container with id 71b2e99ff97d17c66a946811735629e37380003100d7522e01f4b0a522710083 Jun 08 22:59:21.891708 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.891667 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406b614c-8a06-4ef8-85cc-4de0e625a411" path="/var/lib/kubelet/pods/406b614c-8a06-4ef8-85cc-4de0e625a411/volumes" Jun 08 22:59:21.963434 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.963381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" event={"ID":"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc","Type":"ContainerStarted","Data":"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3"} Jun 08 22:59:21.963841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.963465 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" event={"ID":"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc","Type":"ContainerStarted","Data":"71b2e99ff97d17c66a946811735629e37380003100d7522e01f4b0a522710083"} Jun 08 22:59:21.963841 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.963579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:21.965027 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.965007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" event={"ID":"c00f93e0-e75d-4974-8059-872ff2f54e1d","Type":"ContainerStarted","Data":"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6"} Jun 08 22:59:21.965146 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.965048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" event={"ID":"c00f93e0-e75d-4974-8059-872ff2f54e1d","Type":"ContainerStarted","Data":"4aed56a20f2666eaa2b74c478dd945593876454c43bd91e42e18e7878d79e724"} Jun 08 22:59:21.965146 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.965073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:21.966543 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.966518 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" containerName="manager" containerID="cri-o://a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891" gracePeriod=2 Jun 08 22:59:21.985583 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:21.985535 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" podStartSLOduration=1.9855166990000002 podStartE2EDuration="1.985516699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:59:21.982606313 +0000 UTC m=+704.539436181" watchObservedRunningTime="2026-06-08 22:59:21.985516699 +0000 UTC m=+704.542346540" Jun 08 22:59:22.000408 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.000362 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" podStartSLOduration=2.000348648 podStartE2EDuration="2.000348648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:59:21.998864245 +0000 UTC m=+704.555694084" watchObservedRunningTime="2026-06-08 22:59:22.000348648 +0000 UTC m=+704.557178489" Jun 08 22:59:22.216287 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.216252 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:22.218817 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:22.218791 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:22.321464 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.321354 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k9hc\" (UniqueName: \"kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc\") pod \"56327582-ac6e-42cd-bfca-1c3c9769119a\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " Jun 08 22:59:22.321611 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.321479 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume\") pod \"56327582-ac6e-42cd-bfca-1c3c9769119a\" (UID: \"56327582-ac6e-42cd-bfca-1c3c9769119a\") " Jun 08 22:59:22.321763 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.321731 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "56327582-ac6e-42cd-bfca-1c3c9769119a" (UID: "56327582-ac6e-42cd-bfca-1c3c9769119a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:59:22.323480 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.323446 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc" (OuterVolumeSpecName: "kube-api-access-7k9hc") pod "56327582-ac6e-42cd-bfca-1c3c9769119a" (UID: "56327582-ac6e-42cd-bfca-1c3c9769119a"). InnerVolumeSpecName "kube-api-access-7k9hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:59:22.422468 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.422409 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k9hc\" (UniqueName: \"kubernetes.io/projected/56327582-ac6e-42cd-bfca-1c3c9769119a-kube-api-access-7k9hc\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:22.422468 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.422467 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56327582-ac6e-42cd-bfca-1c3c9769119a-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:22.973977 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.973941 2556 generic.go:356] "Generic (PLEG): container finished" podID="56327582-ac6e-42cd-bfca-1c3c9769119a" containerID="a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891" exitCode=2 Jun 08 22:59:22.973977 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.973979 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:22.974566 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.974045 2556 scope.go:117] "RemoveContainer" containerID="a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891" Jun 08 22:59:22.976713 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:22.976685 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:22.983267 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.983251 2556 scope.go:117] "RemoveContainer" containerID="a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891" Jun 08 22:59:22.983564 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:22.983544 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891\": container with ID starting with a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891 not found: ID does not exist" containerID="a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891" Jun 08 22:59:22.983626 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:22.983572 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891"} err="failed to get container status \"a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891\": rpc error: code = NotFound desc = could not find container \"a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891\": container with ID starting with a7b9ca273a8d052586369dbafb3c7f7521b45dd38c7979747229691ba902c891 not found: ID does not exist" Jun 08 22:59:22.984582 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:22.984559 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sxbv5\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sxbv5" Jun 08 22:59:23.892392 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:23.892355 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56327582-ac6e-42cd-bfca-1c3c9769119a" path="/var/lib/kubelet/pods/56327582-ac6e-42cd-bfca-1c3c9769119a/volumes" Jun 08 22:59:32.976358 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:32.976326 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:32.976832 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:32.976409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:33.027894 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.027861 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:33.028092 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.028028 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" podUID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" containerName="manager" containerID="cri-o://fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3" gracePeriod=10 Jun 08 22:59:33.279052 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.279021 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7"] Jun 08 22:59:33.283002 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.282980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.286447 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.286403 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:33.295053 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.295026 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7"] Jun 08 22:59:33.424568 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.424536 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume\") pod \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " Jun 08 22:59:33.424744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.424586 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klpz7\" (UniqueName: \"kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7\") pod \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\" (UID: \"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc\") " Jun 08 22:59:33.424744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.424680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd891140-0445-4614-a178-31637eb856bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.424744 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.424699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldxj\" (UniqueName: \"kubernetes.io/projected/fd891140-0445-4614-a178-31637eb856bb-kube-api-access-gldxj\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.424936 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.424911 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" (UID: "3bf880ac-65b8-41d9-a4c6-7ea479deb4fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:59:33.426679 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.426659 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7" (OuterVolumeSpecName: "kube-api-access-klpz7") pod "3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" (UID: "3bf880ac-65b8-41d9-a4c6-7ea479deb4fc"). InnerVolumeSpecName "kube-api-access-klpz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:59:33.526042 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.525949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd891140-0445-4614-a178-31637eb856bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.526042 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.525985 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gldxj\" (UniqueName: \"kubernetes.io/projected/fd891140-0445-4614-a178-31637eb856bb-kube-api-access-gldxj\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.526229 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.526057 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klpz7\" (UniqueName: \"kubernetes.io/projected/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-kube-api-access-klpz7\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:33.526229 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.526068 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:33.526371 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.526348 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd891140-0445-4614-a178-31637eb856bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.534918 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.534886 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldxj\" (UniqueName: \"kubernetes.io/projected/fd891140-0445-4614-a178-31637eb856bb-kube-api-access-gldxj\") pod \"kuadrant-operator-controller-manager-86878c769f-z6ps7\" (UID: \"fd891140-0445-4614-a178-31637eb856bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.594517 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.594471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:33.729707 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:33.729669 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7"] Jun 08 22:59:33.732941 ip-10-0-141-245 kubenswrapper[2556]: W0608 22:59:33.732904 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd891140_0445_4614_a178_31637eb856bb.slice/crio-bbcd7b1c6274f291272a1402f10164529542762f1015a852de53226b108da51e WatchSource:0}: Error finding container bbcd7b1c6274f291272a1402f10164529542762f1015a852de53226b108da51e: Status 404 returned error can't find the container with id bbcd7b1c6274f291272a1402f10164529542762f1015a852de53226b108da51e Jun 08 22:59:34.033621 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.033584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" event={"ID":"fd891140-0445-4614-a178-31637eb856bb","Type":"ContainerStarted","Data":"dbe4748feaa335e4936899c9daffeac4ed29f2f3ee2365ecb584f3fbd95bafb5"} Jun 08 22:59:34.034043 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.033744 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:34.034043 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.033773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" event={"ID":"fd891140-0445-4614-a178-31637eb856bb","Type":"ContainerStarted","Data":"bbcd7b1c6274f291272a1402f10164529542762f1015a852de53226b108da51e"} Jun 08 22:59:34.034971 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.034918 2556 generic.go:356] "Generic (PLEG): container finished" podID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" containerID="fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3" exitCode=0 Jun 08 22:59:34.034971 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.034953 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" Jun 08 22:59:34.034971 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.034964 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" event={"ID":"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc","Type":"ContainerDied","Data":"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3"} Jun 08 22:59:34.035112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.034992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8" event={"ID":"3bf880ac-65b8-41d9-a4c6-7ea479deb4fc","Type":"ContainerDied","Data":"71b2e99ff97d17c66a946811735629e37380003100d7522e01f4b0a522710083"} Jun 08 22:59:34.035112 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.035013 2556 scope.go:117] "RemoveContainer" containerID="fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3" Jun 08 22:59:34.044671 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.044649 2556 scope.go:117] "RemoveContainer" containerID="fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3" Jun 08 22:59:34.044992 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:34.044968 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3\": container with ID starting with fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3 not found: ID does not exist" containerID="fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3" Jun 08 22:59:34.045063 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.045003 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3"} err="failed to get container status \"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3\": rpc error: code = NotFound desc = could not find container \"fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3\": container with ID starting with fdd960308ca8214e72f15fc84c3b3fa8d79737ae55317f8d47ad061bf48424a3 not found: ID does not exist" Jun 08 22:59:34.055180 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.055134 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" podStartSLOduration=1.055120468 podStartE2EDuration="1.055120468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:59:34.05423692 +0000 UTC m=+716.611066759" watchObservedRunningTime="2026-06-08 22:59:34.055120468 +0000 UTC m=+716.611950307" Jun 08 22:59:34.068745 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.068715 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:34.074622 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:34.074592 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hvbc8"] Jun 08 22:59:35.892287 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:35.892256 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" path="/var/lib/kubelet/pods/3bf880ac-65b8-41d9-a4c6-7ea479deb4fc/volumes" Jun 08 22:59:45.043580 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.043542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z6ps7" Jun 08 22:59:45.095012 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.094969 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:45.095309 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.095278 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" podUID="c00f93e0-e75d-4974-8059-872ff2f54e1d" containerName="manager" containerID="cri-o://dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6" gracePeriod=10 Jun 08 22:59:45.358030 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.358006 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:45.444219 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.444180 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9qbw\" (UniqueName: \"kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw\") pod \"c00f93e0-e75d-4974-8059-872ff2f54e1d\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " Jun 08 22:59:45.444219 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.444220 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume\") pod \"c00f93e0-e75d-4974-8059-872ff2f54e1d\" (UID: \"c00f93e0-e75d-4974-8059-872ff2f54e1d\") " Jun 08 22:59:45.444806 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.444770 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c00f93e0-e75d-4974-8059-872ff2f54e1d" (UID: "c00f93e0-e75d-4974-8059-872ff2f54e1d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:59:45.446412 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.446386 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw" (OuterVolumeSpecName: "kube-api-access-g9qbw") pod "c00f93e0-e75d-4974-8059-872ff2f54e1d" (UID: "c00f93e0-e75d-4974-8059-872ff2f54e1d"). InnerVolumeSpecName "kube-api-access-g9qbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:59:45.545618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.545579 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9qbw\" (UniqueName: \"kubernetes.io/projected/c00f93e0-e75d-4974-8059-872ff2f54e1d-kube-api-access-g9qbw\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:45.545618 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:45.545612 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c00f93e0-e75d-4974-8059-872ff2f54e1d-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" Jun 08 22:59:46.105682 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.105645 2556 generic.go:356] "Generic (PLEG): container finished" podID="c00f93e0-e75d-4974-8059-872ff2f54e1d" containerID="dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6" exitCode=0 Jun 08 22:59:46.106073 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.105695 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" Jun 08 22:59:46.106073 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.105693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" event={"ID":"c00f93e0-e75d-4974-8059-872ff2f54e1d","Type":"ContainerDied","Data":"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6"} Jun 08 22:59:46.106073 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.105819 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5" event={"ID":"c00f93e0-e75d-4974-8059-872ff2f54e1d","Type":"ContainerDied","Data":"4aed56a20f2666eaa2b74c478dd945593876454c43bd91e42e18e7878d79e724"} Jun 08 22:59:46.106073 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.105849 2556 scope.go:117] "RemoveContainer" containerID="dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6" Jun 08 22:59:46.115013 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.114995 2556 scope.go:117] "RemoveContainer" containerID="dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6" Jun 08 22:59:46.115280 ip-10-0-141-245 kubenswrapper[2556]: E0608 22:59:46.115260 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6\": container with ID starting with dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6 not found: ID does not exist" containerID="dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6" Jun 08 22:59:46.115329 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.115290 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6"} err="failed to get container status \"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6\": rpc error: code = NotFound desc = could not find container \"dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6\": container with ID starting with dd678021720e6907d89b12169fd9d03bf24288d5b2900414e1cfa9fd0ba055d6 not found: ID does not exist" Jun 08 22:59:46.131734 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.131706 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:46.135076 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:46.135053 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5kwg5"] Jun 08 22:59:47.892008 ip-10-0-141-245 kubenswrapper[2556]: I0608 22:59:47.891973 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00f93e0-e75d-4974-8059-872ff2f54e1d" path="/var/lib/kubelet/pods/c00f93e0-e75d-4974-8059-872ff2f54e1d/volumes" Jun 08 23:00:04.075582 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.075543 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:00:04.076024 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.075992 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" containerName="manager" Jun 08 23:00:04.076024 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.076010 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" containerName="manager" Jun 08 23:00:04.076152 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.076044 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00f93e0-e75d-4974-8059-872ff2f54e1d" containerName="manager" Jun 08 23:00:04.076152 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.076053 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00f93e0-e75d-4974-8059-872ff2f54e1d" containerName="manager" Jun 08 23:00:04.076152 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.076146 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf880ac-65b8-41d9-a4c6-7ea479deb4fc" containerName="manager" Jun 08 23:00:04.076312 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.076160 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00f93e0-e75d-4974-8059-872ff2f54e1d" containerName="manager" Jun 08 23:00:04.079389 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.079371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.081851 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.081829 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ksx8k\"" Jun 08 23:00:04.081851 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.081830 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 23:00:04.086199 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.086174 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:00:04.112717 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.112688 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:00:04.222962 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.222927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvf5c\" (UniqueName: \"kubernetes.io/projected/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-kube-api-access-xvf5c\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.223168 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.222977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-config-file\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.323751 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.323715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvf5c\" (UniqueName: \"kubernetes.io/projected/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-kube-api-access-xvf5c\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.323751 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.323757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-config-file\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.324352 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.324333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-config-file\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.331529 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.331466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvf5c\" (UniqueName: \"kubernetes.io/projected/5d9c0938-0f11-44d6-a0a4-8605c90df6b5-kube-api-access-xvf5c\") pod \"limitador-limitador-54d6d988d5-hdpdg\" (UID: \"5d9c0938-0f11-44d6-a0a4-8605c90df6b5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.391352 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.391307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:04.522280 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:04.522250 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:00:04.524338 ip-10-0-141-245 kubenswrapper[2556]: W0608 23:00:04.524310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9c0938_0f11_44d6_a0a4_8605c90df6b5.slice/crio-64288824dfa7ef8edab1d26fbeba0669d4623c75bfb39e186a75a870b6c1deba WatchSource:0}: Error finding container 64288824dfa7ef8edab1d26fbeba0669d4623c75bfb39e186a75a870b6c1deba: Status 404 returned error can't find the container with id 64288824dfa7ef8edab1d26fbeba0669d4623c75bfb39e186a75a870b6c1deba Jun 08 23:00:05.202529 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:05.202449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" event={"ID":"5d9c0938-0f11-44d6-a0a4-8605c90df6b5","Type":"ContainerStarted","Data":"64288824dfa7ef8edab1d26fbeba0669d4623c75bfb39e186a75a870b6c1deba"} Jun 08 23:00:07.216264 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:07.216224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" event={"ID":"5d9c0938-0f11-44d6-a0a4-8605c90df6b5","Type":"ContainerStarted","Data":"cda79d8a0047d7540d729e930a9d73013995fdbcfff27690d3a70eb190af763e"} Jun 08 23:00:07.216712 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:07.216342 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:00:07.231964 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:07.231912 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" podStartSLOduration=0.696589205 podStartE2EDuration="3.231896504s" totalImagesPullingTime="2.535307299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:00:07.230949067 +0000 UTC m=+749.787778907" watchObservedRunningTime="2026-06-08 23:00:07.231896504 +0000 UTC m=+749.788726344" Jun 08 23:00:18.222552 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:00:18.222522 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hdpdg" Jun 08 23:02:05.688339 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:02:05.688306 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:02:37.918797 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:02:37.918725 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:02:37.920530 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:02:37.920509 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:03:11.528708 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:11.528669 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:03:23.898843 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.898807 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75"] Jun 08 23:03:23.902346 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.902323 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.905184 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.905162 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 23:03:23.905309 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.905161 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kdf8k\"" Jun 08 23:03:23.906391 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.906369 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 23:03:23.906511 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.906450 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 23:03:23.910841 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.910684 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75"] Jun 08 23:03:23.975471 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.975695 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.975695 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f1d5d6-114e-4593-9599-2031c55a9dd1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.975834 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.975834 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:23.975922 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:23.975849 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8cbr\" (UniqueName: \"kubernetes.io/projected/69f1d5d6-114e-4593-9599-2031c55a9dd1-kube-api-access-t8cbr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077402 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077402 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077664 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8cbr\" (UniqueName: \"kubernetes.io/projected/69f1d5d6-114e-4593-9599-2031c55a9dd1-kube-api-access-t8cbr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077664 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077664 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077664 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f1d5d6-114e-4593-9599-2031c55a9dd1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077868 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077815 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077930 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.077930 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.077906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.079931 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.079905 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f1d5d6-114e-4593-9599-2031c55a9dd1-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.080213 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.080194 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f1d5d6-114e-4593-9599-2031c55a9dd1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.085364 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.085343 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8cbr\" (UniqueName: \"kubernetes.io/projected/69f1d5d6-114e-4593-9599-2031c55a9dd1-kube-api-access-t8cbr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-trc75\" (UID: \"69f1d5d6-114e-4593-9599-2031c55a9dd1\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.215987 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.215888 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:24.341461 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.341402 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:03:24.354412 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.354354 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75"] Jun 08 23:03:24.356943 ip-10-0-141-245 kubenswrapper[2556]: W0608 23:03:24.356918 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f1d5d6_114e_4593_9599_2031c55a9dd1.slice/crio-314f421e0e870080a9431a3d17e13ef3a13ddec3fffe4ce882c50cb8d6dc0041 WatchSource:0}: Error finding container 314f421e0e870080a9431a3d17e13ef3a13ddec3fffe4ce882c50cb8d6dc0041: Status 404 returned error can't find the container with id 314f421e0e870080a9431a3d17e13ef3a13ddec3fffe4ce882c50cb8d6dc0041 Jun 08 23:03:24.358776 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:24.358760 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 23:03:25.186580 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:25.186535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" event={"ID":"69f1d5d6-114e-4593-9599-2031c55a9dd1","Type":"ContainerStarted","Data":"314f421e0e870080a9431a3d17e13ef3a13ddec3fffe4ce882c50cb8d6dc0041"} Jun 08 23:03:28.204027 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:28.203994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" event={"ID":"69f1d5d6-114e-4593-9599-2031c55a9dd1","Type":"ContainerStarted","Data":"47c2528e8bacc9841066fb7b28544ab9b7e76f01a10b6ef7bec7b584c0f093d2"} Jun 08 23:03:32.226276 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:32.226241 2556 generic.go:356] "Generic (PLEG): container finished" podID="69f1d5d6-114e-4593-9599-2031c55a9dd1" containerID="47c2528e8bacc9841066fb7b28544ab9b7e76f01a10b6ef7bec7b584c0f093d2" exitCode=0 Jun 08 23:03:32.226670 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:32.226320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" event={"ID":"69f1d5d6-114e-4593-9599-2031c55a9dd1","Type":"ContainerDied","Data":"47c2528e8bacc9841066fb7b28544ab9b7e76f01a10b6ef7bec7b584c0f093d2"} Jun 08 23:03:34.239336 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:34.239298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" event={"ID":"69f1d5d6-114e-4593-9599-2031c55a9dd1","Type":"ContainerStarted","Data":"21f0022d0bceb43b09b5ecdbbbc750b9d7411dc42fcf08f4686a338f26c5a665"} Jun 08 23:03:34.258615 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:34.258566 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" podStartSLOduration=2.535431181 podStartE2EDuration="11.25855019s" totalImagesPullingTime="4.346944366s" totalInitContainerRuntime="4.376174643s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:03:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:03:34.2570322 +0000 UTC m=+956.813896262" watchObservedRunningTime="2026-06-08 23:03:34.25855019 +0000 UTC m=+956.815380029" Jun 08 23:03:40.131981 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:40.131946 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:03:44.216415 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:44.216372 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:44.216959 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:44.216453 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:44.229006 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:44.228982 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:44.301662 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:44.301626 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-trc75" Jun 08 23:03:46.521077 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.521044 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp"] Jun 08 23:03:46.527989 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.527968 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.530769 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.530747 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 23:03:46.535807 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.535788 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp"] Jun 08 23:03:46.600720 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.600900 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.600900 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc57b1-647f-4e86-9e37-a0c822661d69-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.600900 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.601012 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vts2t\" (UniqueName: \"kubernetes.io/projected/6cfc57b1-647f-4e86-9e37-a0c822661d69-kube-api-access-vts2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.601012 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.600939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702318 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702318 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702638 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702638 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc57b1-647f-4e86-9e37-a0c822661d69-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702638 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702638 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2t\" (UniqueName: \"kubernetes.io/projected/6cfc57b1-647f-4e86-9e37-a0c822661d69-kube-api-access-vts2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.702857 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.702779 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.703125 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.703075 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.703246 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.703170 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.704691 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.704670 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cfc57b1-647f-4e86-9e37-a0c822661d69-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.704981 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.704964 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc57b1-647f-4e86-9e37-a0c822661d69-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.710038 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.710009 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vts2t\" (UniqueName: \"kubernetes.io/projected/6cfc57b1-647f-4e86-9e37-a0c822661d69-kube-api-access-vts2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp\" (UID: \"6cfc57b1-647f-4e86-9e37-a0c822661d69\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.839665 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.839579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:46.981231 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:46.981194 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp"] Jun 08 23:03:46.984464 ip-10-0-141-245 kubenswrapper[2556]: W0608 23:03:46.984433 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfc57b1_647f_4e86_9e37_a0c822661d69.slice/crio-cb139af65e74bd6ecce58495c97eb2e363fc15a17d5265b9246e31553bbdda47 WatchSource:0}: Error finding container cb139af65e74bd6ecce58495c97eb2e363fc15a17d5265b9246e31553bbdda47: Status 404 returned error can't find the container with id cb139af65e74bd6ecce58495c97eb2e363fc15a17d5265b9246e31553bbdda47 Jun 08 23:03:47.027766 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:47.027738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:03:47.309697 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:47.309659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" event={"ID":"6cfc57b1-647f-4e86-9e37-a0c822661d69","Type":"ContainerStarted","Data":"6ef86fea343dc9484c9fc3607d6bf0ac17241cd7a51028e8c92c866f00587e93"} Jun 08 23:03:47.309880 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:47.309724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" event={"ID":"6cfc57b1-647f-4e86-9e37-a0c822661d69","Type":"ContainerStarted","Data":"cb139af65e74bd6ecce58495c97eb2e363fc15a17d5265b9246e31553bbdda47"} Jun 08 23:03:49.321725 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:49.321690 2556 generic.go:356] "Generic (PLEG): container finished" podID="6cfc57b1-647f-4e86-9e37-a0c822661d69" containerID="6ef86fea343dc9484c9fc3607d6bf0ac17241cd7a51028e8c92c866f00587e93" exitCode=0 Jun 08 23:03:49.322118 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:49.321763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" event={"ID":"6cfc57b1-647f-4e86-9e37-a0c822661d69","Type":"ContainerDied","Data":"6ef86fea343dc9484c9fc3607d6bf0ac17241cd7a51028e8c92c866f00587e93"} Jun 08 23:03:50.328166 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:50.328131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" event={"ID":"6cfc57b1-647f-4e86-9e37-a0c822661d69","Type":"ContainerStarted","Data":"1c32391c37850342753635121d87641242e1da7345a873265736866f93282486"} Jun 08 23:03:50.348305 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:50.348253 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" podStartSLOduration=2.852858127 podStartE2EDuration="4.348237128s" totalImagesPullingTime="200.917735ms" totalInitContainerRuntime="1.294461266s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:03:50.345690693 +0000 UTC m=+972.902520535" watchObservedRunningTime="2026-06-08 23:03:50.348237128 +0000 UTC m=+972.905066982" Jun 08 23:03:54.219574 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.219489 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7"] Jun 08 23:03:54.234495 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.234456 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.234677 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.234566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7"] Jun 08 23:03:54.237101 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.237077 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 23:03:54.278303 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.278486 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e04e894-80c6-4ced-b077-25b5a2f56c46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.278486 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.278486 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt98z\" (UniqueName: \"kubernetes.io/projected/8e04e894-80c6-4ced-b077-25b5a2f56c46-kube-api-access-xt98z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.278634 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.278634 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.278552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379435 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379629 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379629 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379514 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379629 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e04e894-80c6-4ced-b077-25b5a2f56c46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379629 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379629 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt98z\" (UniqueName: \"kubernetes.io/projected/8e04e894-80c6-4ced-b077-25b5a2f56c46-kube-api-access-xt98z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379905 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379853 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.379905 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379884 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.380009 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.379980 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.381924 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.381903 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e04e894-80c6-4ced-b077-25b5a2f56c46-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.382091 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.382075 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e04e894-80c6-4ced-b077-25b5a2f56c46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.390243 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.390219 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt98z\" (UniqueName: \"kubernetes.io/projected/8e04e894-80c6-4ced-b077-25b5a2f56c46-kube-api-access-xt98z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7\" (UID: \"8e04e894-80c6-4ced-b077-25b5a2f56c46\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.547316 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.547267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:03:54.683927 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.683901 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7"] Jun 08 23:03:54.686603 ip-10-0-141-245 kubenswrapper[2556]: W0608 23:03:54.686569 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e04e894_80c6_4ced_b077_25b5a2f56c46.slice/crio-13e092cf4517c4e64a48928d295c718b8956183f7371764f13c9f43e944a622e WatchSource:0}: Error finding container 13e092cf4517c4e64a48928d295c718b8956183f7371764f13c9f43e944a622e: Status 404 returned error can't find the container with id 13e092cf4517c4e64a48928d295c718b8956183f7371764f13c9f43e944a622e Jun 08 23:03:54.930820 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:54.930740 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:03:55.355200 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:55.355161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" event={"ID":"8e04e894-80c6-4ced-b077-25b5a2f56c46","Type":"ContainerStarted","Data":"c5a0902fe159bf23963be0a1d376a8ee939ff73c35be2efd316f32d4ef2134f5"} Jun 08 23:03:55.355625 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:55.355223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" event={"ID":"8e04e894-80c6-4ced-b077-25b5a2f56c46","Type":"ContainerStarted","Data":"13e092cf4517c4e64a48928d295c718b8956183f7371764f13c9f43e944a622e"} Jun 08 23:03:56.839982 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:56.839927 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:56.840529 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:56.840015 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:56.852616 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:56.852588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:57.378521 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:57.378489 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp" Jun 08 23:03:58.837141 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:03:58.837105 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:04:39.584598 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:39.584562 2556 generic.go:356] "Generic (PLEG): container finished" podID="8e04e894-80c6-4ced-b077-25b5a2f56c46" containerID="c5a0902fe159bf23963be0a1d376a8ee939ff73c35be2efd316f32d4ef2134f5" exitCode=0 Jun 08 23:04:39.585026 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:39.584612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" event={"ID":"8e04e894-80c6-4ced-b077-25b5a2f56c46","Type":"ContainerDied","Data":"c5a0902fe159bf23963be0a1d376a8ee939ff73c35be2efd316f32d4ef2134f5"} Jun 08 23:04:40.591793 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:40.591755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" event={"ID":"8e04e894-80c6-4ced-b077-25b5a2f56c46","Type":"ContainerStarted","Data":"c96bfa9c50f4c64e27437543f2a3219ae9a1d40ed70ce50d598d7edf26ca4f33"} Jun 08 23:04:40.609309 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:40.609257 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" podStartSLOduration=1.848885651 podStartE2EDuration="46.60924241s" totalImagesPullingTime="179.222354ms" totalInitContainerRuntime="44.581134405s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:04:40.608156949 +0000 UTC m=+1023.164986789" watchObservedRunningTime="2026-06-08 23:04:40.60924241 +0000 UTC m=+1023.166072249" Jun 08 23:04:44.547682 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:44.547643 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:04:44.548089 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:44.547699 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:04:44.560694 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:44.560662 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:04:44.622166 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:04:44.622131 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7" Jun 08 23:05:25.330028 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:05:25.329935 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:05:35.429696 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:05:35.429661 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:05:44.533361 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:05:44.533323 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:05:54.521809 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:05:54.521775 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:03.828908 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:03.828872 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:13.621388 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:13.621354 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:46.627894 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:46.627855 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:49.925350 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:49.925314 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:55.232842 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:55.232763 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:06:58.123153 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:06:58.123114 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:07:26.037613 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:07:26.037572 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:07:37.953350 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:07:37.953320 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:07:37.956210 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:07:37.956187 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:07:42.526989 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:07:42.526954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:08:20.746319 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:08:20.746282 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:08:37.432628 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:08:37.432593 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:08:51.636056 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:08:51.636013 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:09:06.929096 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:09:06.929057 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:09:10.123618 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:09:10.123582 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:09:45.625327 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:09:45.625289 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:09:48.725432 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:09:48.725385 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:10:11.027727 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:10:11.027642 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:10:20.126485 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:10:20.126447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:10:36.525042 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:10:36.525002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:10:45.123164 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:10:45.123118 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:11:02.125855 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:11:02.125821 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:11:11.127396 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:11:11.127359 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:03.528783 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:03.528748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:12.522532 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:12.522500 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:14.928543 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:14.928511 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:20.923908 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:20.923870 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:28.728907 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:28.728870 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:37.032597 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:37.032561 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:37.990119 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:37.990087 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:12:37.993938 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:37.993914 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:12:45.439852 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:45.439814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:48.228477 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:48.228445 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:12:54.432935 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:12:54.432846 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:13:06.326005 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:13:06.325968 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:13:43.823562 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:13:43.823529 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:13:46.028955 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:13:46.028922 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hdpdg"] Jun 08 23:14:16.319764 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:16.319735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cdd97b9c-p4ttn_bfff357d-47ff-4525-8a1c-4cd6fe967047/copy-manifests/0.log" Jun 08 23:14:16.337529 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:16.337501 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cdd97b9c-p4ttn_bfff357d-47ff-4525-8a1c-4cd6fe967047/manager/0.log" Jun 08 23:14:18.115396 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:18.115363 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z6ps7_fd891140-0445-4614-a178-31637eb856bb/manager/0.log" Jun 08 23:14:18.221709 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:18.221681 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hdpdg_5d9c0938-0f11-44d6-a0a4-8605c90df6b5/limitador/0.log" Jun 08 23:14:18.885254 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:18.885225 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85448bb448-fkgqn_7e51a766-98e9-4522-aa21-d41b380ec042/kube-auth-proxy/0.log" Jun 08 23:14:19.874008 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:19.873974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-trc75_69f1d5d6-114e-4593-9599-2031c55a9dd1/storage-initializer/0.log" Jun 08 23:14:19.881496 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:19.881474 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-trc75_69f1d5d6-114e-4593-9599-2031c55a9dd1/main/0.log" Jun 08 23:14:20.109917 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:20.109883 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp_6cfc57b1-647f-4e86-9e37-a0c822661d69/storage-initializer/0.log" Jun 08 23:14:20.116500 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:20.116478 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvfjbp_6cfc57b1-647f-4e86-9e37-a0c822661d69/main/0.log" Jun 08 23:14:20.228545 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:20.228467 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7_8e04e894-80c6-4ced-b077-25b5a2f56c46/storage-initializer/0.log" Jun 08 23:14:20.234926 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:20.234907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tdvs7_8e04e894-80c6-4ced-b077-25b5a2f56c46/main/0.log" Jun 08 23:14:27.592536 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:27.592454 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rw2sg_ea3e4fff-bc8f-49d2-aaa2-22b2851605e5/global-pull-secret-syncer/0.log" Jun 08 23:14:27.728595 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:27.728554 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bxqfp_f92167ab-11f7-4873-abb5-3b13cbf7d73a/konnectivity-agent/0.log" Jun 08 23:14:27.817918 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:27.817889 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-245.ec2.internal_180adb5a001eed42bf585f00ceb86a9d/haproxy/0.log" Jun 08 23:14:32.875765 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:32.875731 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z6ps7_fd891140-0445-4614-a178-31637eb856bb/manager/0.log" Jun 08 23:14:32.897305 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:32.897280 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hdpdg_5d9c0938-0f11-44d6-a0a4-8605c90df6b5/limitador/0.log" Jun 08 23:14:34.694588 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.694510 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/alertmanager/0.log" Jun 08 23:14:34.711285 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.711256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/config-reloader/0.log" Jun 08 23:14:34.731144 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.731119 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/kube-rbac-proxy-web/0.log" Jun 08 23:14:34.749723 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.749697 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/kube-rbac-proxy/0.log" Jun 08 23:14:34.767002 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.766976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/kube-rbac-proxy-metric/0.log" Jun 08 23:14:34.781884 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.781860 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/prom-label-proxy/0.log" Jun 08 23:14:34.799639 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.799613 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c87039b-6949-4f93-a943-e736511a4b24/init-config-reloader/0.log" Jun 08 23:14:34.841477 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.841434 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-f6x2p_bcc3df8b-9214-4c1e-b7b9-932e754754fd/cluster-monitoring-operator/0.log" Jun 08 23:14:34.869653 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.869630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-state-metrics/0.log" Jun 08 23:14:34.882892 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.882860 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-rbac-proxy-main/0.log" Jun 08 23:14:34.897764 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:34.897738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-llns7_23c22ccd-3e4b-435f-a644-dfa3b34d4d9b/kube-rbac-proxy-self/0.log" Jun 08 23:14:35.033772 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.033742 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/node-exporter/0.log" Jun 08 23:14:35.047560 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.047534 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/kube-rbac-proxy/0.log" Jun 08 23:14:35.062143 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.062121 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqq5g_89c0f0ae-304d-4e64-a5ac-70b4410a80f4/init-textfile/0.log" Jun 08 23:14:35.143950 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.143923 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/kube-rbac-proxy-main/0.log" Jun 08 23:14:35.160579 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.160555 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/kube-rbac-proxy-self/0.log" Jun 08 23:14:35.177336 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.177309 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tmq4f_e92f558b-15be-4dbf-b0ca-e76b41103bfb/openshift-state-metrics/0.log" Jun 08 23:14:35.207461 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.207415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/prometheus/0.log" Jun 08 23:14:35.222199 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.222171 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/config-reloader/0.log" Jun 08 23:14:35.237716 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.237689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/thanos-sidecar/0.log" Jun 08 23:14:35.254558 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.254530 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/kube-rbac-proxy-web/0.log" Jun 08 23:14:35.274868 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.274846 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/kube-rbac-proxy/0.log" Jun 08 23:14:35.295279 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.295201 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/kube-rbac-proxy-thanos/0.log" Jun 08 23:14:35.318277 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.318243 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4cc6625-6ff5-4d46-ac26-75ae4c9ad080/init-config-reloader/0.log" Jun 08 23:14:35.401797 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.401772 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-r8n6n_29793c23-7a67-4735-8288-f5e6744f7117/prometheus-operator-admission-webhook/0.log" Jun 08 23:14:35.508626 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.508597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/thanos-query/0.log" Jun 08 23:14:35.523787 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.523760 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-web/0.log" Jun 08 23:14:35.538570 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.538543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy/0.log" Jun 08 23:14:35.553265 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.553188 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/prom-label-proxy/0.log" Jun 08 23:14:35.570117 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.570091 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-rules/0.log" Jun 08 23:14:35.588972 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:35.588937 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5cf7b858-cks5r_a1ca081d-0e06-40c1-a6c2-20bec73fae52/kube-rbac-proxy-metrics/0.log" Jun 08 23:14:37.218466 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:37.218357 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-zrwkp_be4a3613-f8da-4ef2-b12c-115d13503555/networking-console-plugin/0.log" Jun 08 23:14:37.828074 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:37.828044 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/1.log" Jun 08 23:14:37.839810 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:37.839781 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zzrsq_667997e2-2856-45cd-a9b0-8e17eba4a48f/console-operator/2.log" Jun 08 23:14:38.361490 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:38.361453 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-968dc64dd-9pkpd_f0bccdbb-747b-4aa4-8628-769acb7f994f/console/0.log" Jun 08 23:14:38.393770 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:38.393741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-k55kh_e6f6dca5-397c-4396-8a3f-9befaabd9b05/download-server/0.log" Jun 08 23:14:39.054063 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.054032 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-s5qr5_3bec64fa-bffa-43d6-bca1-0a8dba1506ab/volume-data-source-validator/0.log" Jun 08 23:14:39.638174 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.638143 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56"] Jun 08 23:14:39.641647 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.641629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.644538 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.644511 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4hdn8\"/\"default-dockercfg-bfkrn\"" Jun 08 23:14:39.644684 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.644563 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4hdn8\"/\"openshift-service-ca.crt\"" Jun 08 23:14:39.644684 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.644522 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4hdn8\"/\"kube-root-ca.crt\"" Jun 08 23:14:39.650797 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.650771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56"] Jun 08 23:14:39.686491 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.686460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-sys\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.686491 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.686492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-podres\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.686708 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.686528 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6nm\" (UniqueName: \"kubernetes.io/projected/43734f3e-a227-4c12-9589-ff31595039b1-kube-api-access-rv6nm\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.686708 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.686614 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-proc\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.686781 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.686736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-lib-modules\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.787978 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.787938 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-lib-modules\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.787999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-sys\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-podres\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6nm\" (UniqueName: \"kubernetes.io/projected/43734f3e-a227-4c12-9589-ff31595039b1-kube-api-access-rv6nm\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788089 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-sys\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-proc\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-lib-modules\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788159 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788156 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-proc\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.788410 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.788190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43734f3e-a227-4c12-9589-ff31595039b1-podres\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.795653 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.795634 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6nm\" (UniqueName: \"kubernetes.io/projected/43734f3e-a227-4c12-9589-ff31595039b1-kube-api-access-rv6nm\") pod \"perf-node-gather-daemonset-qxx56\" (UID: \"43734f3e-a227-4c12-9589-ff31595039b1\") " pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:39.953178 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:39.953098 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:40.084105 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.084081 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56"] Jun 08 23:14:40.086559 ip-10-0-141-245 kubenswrapper[2556]: W0608 23:14:40.086530 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43734f3e_a227_4c12_9589_ff31595039b1.slice/crio-02f93bc7c03e5aaf3678c42d2ca89644bcccd39d4cc1fa9986bab26d2557bc50 WatchSource:0}: Error finding container 02f93bc7c03e5aaf3678c42d2ca89644bcccd39d4cc1fa9986bab26d2557bc50: Status 404 returned error can't find the container with id 02f93bc7c03e5aaf3678c42d2ca89644bcccd39d4cc1fa9986bab26d2557bc50 Jun 08 23:14:40.336036 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.336002 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mplf_14499a9d-c2d1-43aa-866e-7ddef1a80ef9/dns/0.log" Jun 08 23:14:40.351313 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.351288 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mplf_14499a9d-c2d1-43aa-866e-7ddef1a80ef9/kube-rbac-proxy/0.log" Jun 08 23:14:40.466986 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.466957 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-splbb_ef23a427-e719-4c05-bc76-fa0efd5c8f17/dns-node-resolver/0.log" Jun 08 23:14:40.690887 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.690792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" event={"ID":"43734f3e-a227-4c12-9589-ff31595039b1","Type":"ContainerStarted","Data":"34330bac4e3f2d1367536aa4ed30aca85a97715897e1882baa6b4c4a21795fb1"} Jun 08 23:14:40.690887 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.690849 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" event={"ID":"43734f3e-a227-4c12-9589-ff31595039b1","Type":"ContainerStarted","Data":"02f93bc7c03e5aaf3678c42d2ca89644bcccd39d4cc1fa9986bab26d2557bc50"} Jun 08 23:14:40.691310 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.690899 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:40.706031 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:40.705985 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" podStartSLOduration=1.7059697200000001 podStartE2EDuration="1.70596972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:14:40.705332661 +0000 UTC m=+1623.262162512" watchObservedRunningTime="2026-06-08 23:14:40.70596972 +0000 UTC m=+1623.262799538" Jun 08 23:14:41.069927 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:41.069894 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddz4r_2e1b96d2-ad5d-409b-9453-f23956fe864b/node-ca/0.log" Jun 08 23:14:42.043950 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:42.043916 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85448bb448-fkgqn_7e51a766-98e9-4522-aa21-d41b380ec042/kube-auth-proxy/0.log" Jun 08 23:14:42.769191 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:42.769157 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gdvwt_b6dc0d0a-6bed-4e3b-a018-711cbc4646fe/serve-healthcheck-canary/0.log" Jun 08 23:14:43.414336 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:43.414309 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4zmv_ef032184-6c6f-47ab-8292-66427aac2a91/kube-rbac-proxy/0.log" Jun 08 23:14:43.429060 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:43.429029 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4zmv_ef032184-6c6f-47ab-8292-66427aac2a91/exporter/0.log" Jun 08 23:14:43.444744 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:43.444716 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4zmv_ef032184-6c6f-47ab-8292-66427aac2a91/extractor/0.log" Jun 08 23:14:45.958136 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:45.958102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cdd97b9c-p4ttn_bfff357d-47ff-4525-8a1c-4cd6fe967047/manager/0.log" Jun 08 23:14:45.970176 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:45.970152 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cdd97b9c-p4ttn_bfff357d-47ff-4525-8a1c-4cd6fe967047/copy-manifests/0.log" Jun 08 23:14:46.706477 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:46.706453 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4hdn8/perf-node-gather-daemonset-qxx56" Jun 08 23:14:47.356010 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:47.355982 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-667ddfcf76-ms4tw_e78c0236-1a66-4cc3-a80b-14dc489833dc/manager/0.log" Jun 08 23:14:47.395847 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:47.395815 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ndm6s_849e268e-258c-4517-82a5-927ff8a91ba4/openshift-lws-operator/0.log" Jun 08 23:14:52.651119 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:52.651078 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-g827r_d6b65e61-e27c-404f-b0d4-89845a05612f/migrator/0.log" Jun 08 23:14:52.666040 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:52.666007 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-g827r_d6b65e61-e27c-404f-b0d4-89845a05612f/graceful-termination/0.log" Jun 08 23:14:53.065957 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:53.065922 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pc6gj_86edf007-30d8-4681-a3d8-79c624b92c43/kube-storage-version-migrator-operator/1.log" Jun 08 23:14:53.067754 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:53.067712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pc6gj_86edf007-30d8-4681-a3d8-79c624b92c43/kube-storage-version-migrator-operator/0.log" Jun 08 23:14:53.575943 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:53.575911 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85448bb448-fkgqn_7e51a766-98e9-4522-aa21-d41b380ec042/kube-auth-proxy/0.log" Jun 08 23:14:54.202852 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.202820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7lsgw_7bc1b881-ce47-4346-9b41-241fb4c053b1/kube-multus/0.log" Jun 08 23:14:54.479316 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.479234 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/kube-multus-additional-cni-plugins/0.log" Jun 08 23:14:54.493590 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.493558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/egress-router-binary-copy/0.log" Jun 08 23:14:54.508794 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.508770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/cni-plugins/0.log" Jun 08 23:14:54.523179 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.523158 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/bond-cni-plugin/0.log" Jun 08 23:14:54.537888 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.537866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/routeoverride-cni/0.log" Jun 08 23:14:54.552596 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.552577 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/whereabouts-cni-bincopy/0.log" Jun 08 23:14:54.568040 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.568023 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-slh84_ff06e628-ccf1-419e-a895-55905b0658c5/whereabouts-cni/0.log" Jun 08 23:14:54.681443 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.681377 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q49tl_147fe20d-97b5-45fb-9ee3-3ed43811b5ae/network-metrics-daemon/0.log" Jun 08 23:14:54.694152 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.694128 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q49tl_147fe20d-97b5-45fb-9ee3-3ed43811b5ae/kube-rbac-proxy/0.log" Jun 08 23:14:54.762319 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:54.762294 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85448bb448-fkgqn_7e51a766-98e9-4522-aa21-d41b380ec042/kube-auth-proxy/0.log" Jun 08 23:14:55.833336 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.833306 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/ovn-controller/0.log" Jun 08 23:14:55.845384 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.845361 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/ovn-acl-logging/0.log" Jun 08 23:14:55.870356 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.870329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/kube-rbac-proxy-node/0.log" Jun 08 23:14:55.893177 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.893151 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 23:14:55.905040 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.904969 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/northd/0.log" Jun 08 23:14:55.920994 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.920967 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/nbdb/0.log" Jun 08 23:14:55.936398 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.936373 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/sbdb/0.log" Jun 08 23:14:55.996264 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:55.996233 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfp78_7dbafa25-af8a-4c11-bd2d-a09e45d5ec29/ovnkube-controller/0.log" Jun 08 23:14:56.513951 ip-10-0-141-245 kubenswrapper[2556]: I0608 23:14:56.513922 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85448bb448-fkgqn_7e51a766-98e9-4522-aa21-d41b380ec042/kube-auth-proxy/0.log"