Jun 08 13:43:48.613271 ip-10-0-141-94 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:43:48.932946 ip-10-0-141-94 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:48.932946 ip-10-0-141-94 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:43:48.932946 ip-10-0-141-94 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:48.932946 ip-10-0-141-94 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:43:48.932946 ip-10-0-141-94 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:48.935066 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.934960 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:43:48.938454 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938438 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.938454 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938454 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938458 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938461 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938464 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938467 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938471 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938473 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938476 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938479 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938482 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938485 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938488 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938491 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938497 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938500 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938503 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938505 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938508 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938510 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938513 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.938518 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938516 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938518 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938521 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938524 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938527 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938529 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938532 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938535 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938537 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938542 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938546 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938549 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938551 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938554 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938556 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938559 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938562 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938564 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938567 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938569 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.939020 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938572 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938575 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938578 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938580 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938583 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938585 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938589 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938592 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938594 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938597 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938599 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938602 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938604 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938607 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938609 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938612 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938614 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938617 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938619 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938622 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.939541 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938624 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938627 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938629 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938631 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938634 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938636 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938641 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938644 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938647 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938649 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938653 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938658 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938661 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938664 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938667 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938670 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938672 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938675 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938678 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.940099 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938682 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938685 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938687 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938690 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938692 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938695 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938698 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938701 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938703 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938706 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938709 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938712 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938715 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938717 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938720 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938722 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938725 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938728 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.938730 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939468 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.940561 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939476 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939480 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939483 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939486 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939489 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939492 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939495 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939497 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939500 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939502 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939505 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939508 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939511 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939514 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939517 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939520 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939524 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939528 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939530 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.941082 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939534 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939537 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939539 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939542 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939545 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939548 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939551 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939553 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939556 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939559 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939562 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939565 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939567 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939570 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939572 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939576 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939578 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939581 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939583 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939586 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.941556 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939589 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939591 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939594 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939596 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939599 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939602 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939606 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939611 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939614 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939616 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939619 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939621 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939624 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939627 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939630 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939633 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939635 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939638 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939640 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939643 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.942063 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939645 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939648 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939651 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939654 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939656 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939659 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939661 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939664 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939666 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939669 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939671 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939674 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939676 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939679 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939681 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939684 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939687 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939690 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939693 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939696 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.942547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939701 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939704 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939706 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939709 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939712 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939714 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939717 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939719 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939722 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939724 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939727 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939730 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939732 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939735 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939739 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939742 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939745 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939748 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.939751 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.943069 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940160 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940166 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940169 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940182 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940185 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940188 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940191 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940193 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940196 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940201 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940204 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940212 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940215 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940219 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940222 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940225 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940228 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940231 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940233 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.943524 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940236 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940238 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940241 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940243 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940246 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940248 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940251 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940254 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940256 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940259 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940261 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940264 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940266 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940269 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940271 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940274 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940277 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940279 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940281 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940284 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.944032 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940286 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940289 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940292 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940294 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940298 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940302 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940305 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940311 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940313 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940316 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940319 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940321 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940324 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940326 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940329 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940331 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940335 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940339 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940342 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940345 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.944554 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940347 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940350 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940352 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940355 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940357 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940359 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940362 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940364 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940366 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940370 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940372 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940375 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940378 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940380 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940383 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940385 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940389 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940391 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940394 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940396 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.945072 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940404 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940407 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940409 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940411 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940414 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940416 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940418 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940421 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940423 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940426 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940429 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940431 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940433 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940436 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940439 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940441 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940443 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940447 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940450 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.945557 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.940453 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940545 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940556 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940566 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940572 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940576 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940579 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940583 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940588 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940591 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940594 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940597 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940600 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940603 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940609 2576 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940611 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940614 2576 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940617 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940620 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940624 2576 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940627 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940630 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940633 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940636 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:43:48.946029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940640 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940642 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940645 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940648 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940651 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940654 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940657 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940660 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940663 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940667 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940670 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940672 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940675 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940678 2576 flags.go:64] FLAG: --enable-server="true" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940680 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940684 2576 flags.go:64] FLAG: --event-burst="100" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940687 2576 flags.go:64] FLAG: --event-qps="50" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940690 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940694 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940697 2576 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940701 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940704 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940708 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940711 2576 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940714 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:43:48.946605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940717 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940720 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940723 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940726 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940728 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940731 2576 flags.go:64] FLAG: --feature-gates="" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940735 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940738 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940741 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940744 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940747 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940750 2576 flags.go:64] FLAG: --help="false" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940753 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-94.ec2.internal" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940756 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940758 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940763 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940768 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940774 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940779 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940783 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940785 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940788 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940791 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940794 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:43:48.947289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940797 2576 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940800 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940802 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940805 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940808 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940813 2576 flags.go:64] FLAG: --lock-file="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940816 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940822 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940826 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940832 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940834 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940837 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940839 2576 flags.go:64] FLAG: --logging-format="text" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940842 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940845 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940848 2576 flags.go:64] FLAG: --manifest-url="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940851 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940855 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940858 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940862 2576 flags.go:64] FLAG: --max-pods="110" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940865 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940868 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940870 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940873 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940876 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:43:48.947892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940879 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940882 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940894 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940897 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940900 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940903 2576 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940905 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940912 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940915 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940918 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940921 2576 flags.go:64] FLAG: --port="10250" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940924 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940928 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c793f918edc1ea9" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940932 2576 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940935 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940939 2576 flags.go:64] FLAG: --register-node="true" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940942 2576 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940945 2576 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940948 2576 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940951 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940954 2576 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940958 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940961 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940964 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940966 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:43:48.948510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940969 2576 flags.go:64] FLAG: --runonce="false" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940972 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940975 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940977 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940980 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940983 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.940999 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941002 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941006 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941008 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941011 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941014 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941016 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941019 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941024 2576 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941026 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941032 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941035 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941037 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941043 2576 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941046 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941049 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941052 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941060 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941063 2576 flags.go:64] FLAG: --v="2" Jun 08 13:43:48.949168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941067 2576 flags.go:64] FLAG: --version="false" Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941071 2576 flags.go:64] FLAG: --vmodule="" Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941075 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941078 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941197 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941201 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941204 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941207 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941210 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941213 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941217 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941220 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941223 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941226 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941228 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941231 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941233 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941236 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941238 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941240 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.949782 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941243 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941247 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941250 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941253 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941255 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941258 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941262 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941265 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941267 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941270 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941273 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941276 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941278 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941281 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941284 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941286 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941289 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941292 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941295 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941297 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.950312 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941300 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941302 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941305 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941307 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941310 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941312 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941315 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941317 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941321 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941325 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941328 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941331 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941334 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941338 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941341 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941344 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941346 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941349 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941352 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941355 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.950808 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941358 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941360 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941364 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941367 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941375 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941378 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941381 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941383 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941386 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941388 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941390 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941396 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941399 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941401 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941403 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941406 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941408 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941411 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941413 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.951409 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941416 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941418 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941421 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941423 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941425 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941428 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941432 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941434 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941437 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941439 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941442 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941446 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941448 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941451 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941454 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941456 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941459 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941461 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941473 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941476 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.951879 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941480 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941483 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941486 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.941488 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.941493 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.948556 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.948574 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.948595 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.948600 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948661 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948666 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948669 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948672 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948675 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948677 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.952389 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948680 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948683 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948685 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948688 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948690 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948693 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948695 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948699 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948703 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948706 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948709 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948712 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948714 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948717 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948720 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948724 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948727 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948730 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948733 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.952766 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948736 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948738 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948741 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948744 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948754 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948758 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948761 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948763 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948766 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948768 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948771 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948773 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948776 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948779 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948781 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948784 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948786 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948789 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948791 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948794 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.953253 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948796 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948799 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948801 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948804 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948806 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948808 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948811 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948813 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948816 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948818 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948821 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948823 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948826 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948828 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948831 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948834 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948837 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948846 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948849 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948851 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.953733 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948854 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948856 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948859 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948861 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948864 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948866 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948868 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948871 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948873 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948876 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948878 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948880 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948883 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948885 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948887 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948890 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948892 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948895 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948897 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948899 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.954233 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948902 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948904 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948906 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948909 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948911 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948913 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948916 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948918 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948921 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948924 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948932 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948934 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948937 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.948939 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.948944 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:48.954717 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949107 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949113 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949117 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949120 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949122 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949125 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949127 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949130 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949133 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949135 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949138 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949140 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949142 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949145 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949147 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949150 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949152 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949155 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949157 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949160 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:48.955162 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949162 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949165 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949168 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949170 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949173 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949176 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949179 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949182 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949191 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949194 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949196 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949198 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949201 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949203 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949206 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949208 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949210 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949213 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949215 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949217 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:48.955642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949220 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949222 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949224 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949227 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949229 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949232 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949234 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949237 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949240 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949243 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949246 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949249 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949252 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949255 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949257 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949260 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949263 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949266 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949268 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:48.956177 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949271 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949274 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949284 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949287 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949289 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949292 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949294 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949297 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949299 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949302 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949304 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949307 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949309 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949312 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949314 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949316 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949319 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949321 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949324 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949326 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:48.956634 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949329 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949331 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949333 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949336 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949338 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949341 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949344 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949346 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949349 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949351 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949354 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949356 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949359 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949361 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949364 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949372 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949375 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949377 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949380 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:48.957117 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:48.949382 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.949387 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.949521 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.953073 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.954145 2576 server.go:1019] "Starting client certificate rotation" Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.954247 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.954281 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:48.957620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.956846 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:48.965786 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.965765 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:48.973801 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.973783 2576 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:43:48.978281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.978265 2576 log.go:25] "Validated CRI v1 image API" Jun 08 13:43:48.979046 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.979028 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:43:48.982969 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.982948 2576 fs.go:135] Filesystem UUIDs: map[222ff1d6-3dc0-49ea-9c6f-2b9c8bc8c48a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d69f3b56-3195-4582-8be5-c42dcddf67ac:/dev/nvme0n1p4] Jun 08 13:43:48.983044 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.982968 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:43:48.987735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.987631 2576 manager.go:216] Machine: {Timestamp:2026-06-08 13:43:48.987133752 +0000 UTC m=+0.277650639 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121020 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d4a2463ae5277b83cb443371265e3 SystemUUID:ec2d4a24-63ae-5277-b83c-b443371265e3 BootID:90f968bb-7e59-4c68-b41e-d4abcf4e226c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:03:f2:fc:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:03:f2:fc:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:8b:4f:13:57:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:43:48.987735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.987728 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:43:48.987845 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.987802 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:43:48.989940 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.989911 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:43:48.990096 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.989941 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:43:48.990651 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.990641 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:43:48.990688 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.990654 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:43:48.990688 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.990661 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:48.991246 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.991234 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:48.992076 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.992064 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:43:48.993663 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.993646 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:48.995203 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995190 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:48.995366 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995356 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:43:48.995411 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995390 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:43:48.995449 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995413 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:43:48.995449 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995440 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:43:48.995523 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995461 2576 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:43:48.995523 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.995479 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:43:48.996143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.996123 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:48.996245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:48.996157 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:49.002199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.002184 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:43:49.007004 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.006968 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:43:49.007080 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.007020 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:43:49.008163 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008138 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008183 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008200 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008207 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008220 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008227 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008236 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008242 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008250 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:43:49.008273 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008277 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:43:49.008654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008297 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:43:49.008654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008303 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:43:49.009030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.008969 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:43:49.009310 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.009297 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:43:49.011112 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.011084 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:43:49.011189 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.011170 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:43:49.011268 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.011254 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:43:49.013018 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.012984 2576 server.go:1268] "Started kubelet" Jun 08 13:43:49.013103 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.013042 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:43:49.013559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.013499 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:43:49.013664 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.013582 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:43:49.013922 ip-10-0-141-94 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:43:49.014874 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.014799 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:43:49.015181 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.015163 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:43:49.017928 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.017130 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-94.ec2.internal.18b71ef8337e459b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-94.ec2.internal,UID:ip-10-0-141-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-94.ec2.internal,},FirstTimestamp:2026-06-08 13:43:49.012956571 +0000 UTC m=+0.303473458,LastTimestamp:2026-06-08 13:43:49.012956571 +0000 UTC m=+0.303473458,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-94.ec2.internal,}" Jun 08 13:43:49.019913 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.019895 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:43:49.020039 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020021 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:49.020112 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.020048 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.020453 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020433 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:43:49.020453 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020435 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:43:49.020616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020462 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:43:49.020709 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020554 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:43:49.020709 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.020709 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:43:49.020848 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.020830 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:43:49.021234 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021216 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:43:49.021234 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021234 2576 factory.go:55] Registering systemd factory Jun 08 13:43:49.021376 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021255 2576 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:43:49.021476 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021457 2576 factory.go:153] Registering CRI-O factory Jun 08 13:43:49.021539 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021481 2576 factory.go:223] Registration of the crio container factory successfully Jun 08 13:43:49.021539 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021518 2576 factory.go:103] Registering Raw factory Jun 08 13:43:49.021539 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021535 2576 manager.go:1196] Started watching for new ooms in manager Jun 08 13:43:49.021656 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021560 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgsv7" Jun 08 13:43:49.022011 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.021979 2576 manager.go:349] Starting recovery of all containers Jun 08 13:43:49.027900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.027878 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgsv7" Jun 08 13:43:49.030243 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.030214 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:43:49.030331 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.030272 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:43:49.032506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.032491 2576 manager.go:354] Recovery completed Jun 08 13:43:49.035872 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.035831 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 08 13:43:49.039142 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.039127 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.041700 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.041683 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.041773 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.041713 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.041773 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.041727 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.043233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.043142 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:43:49.043233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.043157 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:43:49.043233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.043174 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:49.044252 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.044239 2576 policy_none.go:49] "None policy: Start" Jun 08 13:43:49.044293 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.044255 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:43:49.044293 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.044266 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:43:49.044512 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.044494 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.044672 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.044607 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-94.ec2.internal.18b71ef83534dfb4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-94.ec2.internal,UID:ip-10-0-141-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-94.ec2.internal,},FirstTimestamp:2026-06-08 13:43:49.041700788 +0000 UTC m=+0.332217689,LastTimestamp:2026-06-08 13:43:49.041700788 +0000 UTC m=+0.332217689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-94.ec2.internal,}" Jun 08 13:43:49.045302 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.045283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.045356 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.045316 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.045356 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.045326 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.045425 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.045288 2576 policy_none.go:47] "Start" Jun 08 13:43:49.084627 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.084611 2576 manager.go:337] "Starting Device Plugin manager" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.084642 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.084653 2576 server.go:87] "Starting device plugin registration server" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.084905 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.084919 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.085023 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.085097 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.085105 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.085709 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:43:49.088742 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.085764 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.091646 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.091625 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:43:49.092856 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.092840 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:43:49.092950 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.092879 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:43:49.092950 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.092902 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:43:49.092950 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.092938 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:43:49.095495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.095475 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:49.185277 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.185190 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.186186 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.186166 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.186280 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.186201 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.186280 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.186214 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.186280 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.186237 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.192358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.192340 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.192460 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.192367 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-94.ec2.internal\": node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.193862 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.193846 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal"] Jun 08 13:43:49.193916 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.193907 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.194710 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.194693 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.194784 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.194727 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.194784 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.194743 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.195870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.195855 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.195956 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.195944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.196029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.195977 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.196468 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196449 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.196547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196470 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.196547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196481 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.196547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196493 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.196547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196493 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.196547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.196504 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.197509 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.197495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.197595 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.197520 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:49.198111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.198093 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:49.198224 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.198123 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:49.198224 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.198137 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:49.207892 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.207876 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.221673 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.221655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de5821b4975da9b864744e1cc737bdf4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"de5821b4975da9b864744e1cc737bdf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.221743 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.221678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.221743 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.221697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.223692 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.223677 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-94.ec2.internal\" not found" node="ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.228107 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.228091 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-94.ec2.internal\" not found" node="ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.308564 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.308542 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.322187 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de5821b4975da9b864744e1cc737bdf4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"de5821b4975da9b864744e1cc737bdf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.322297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.322297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.322297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.322297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de5821b4975da9b864744e1cc737bdf4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"de5821b4975da9b864744e1cc737bdf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.322297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.322264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db4f7bac20d99b4a8666a76d42fac6ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"db4f7bac20d99b4a8666a76d42fac6ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.409361 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.409325 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.510136 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.510064 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.527629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.527607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.532206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.532188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:49.610912 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.610868 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.711380 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.711346 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.811937 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.811863 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.912369 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:49.912339 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:49.954793 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.954764 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:43:49.955561 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:49.954910 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 13:43:50.012707 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:50.012673 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:50.030483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.030450 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 13:38:49 +0000 UTC" deadline="2028-01-23 18:30:08.371719519 +0000 UTC" Jun 08 13:43:50.030483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.030478 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14260h46m18.341243884s" Jun 08 13:43:50.035205 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.035189 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:50.071972 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:50.071909 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4f7bac20d99b4a8666a76d42fac6ee.slice/crio-0bb2db6ac586a02896c42f81ca5215aba8be949fda121ff3ea8c6a386d9d81af WatchSource:0}: Error finding container 0bb2db6ac586a02896c42f81ca5215aba8be949fda121ff3ea8c6a386d9d81af: Status 404 returned error can't find the container with id 0bb2db6ac586a02896c42f81ca5215aba8be949fda121ff3ea8c6a386d9d81af Jun 08 13:43:50.072149 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:50.072130 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5821b4975da9b864744e1cc737bdf4.slice/crio-feb2a33e8eee7d6a74658b127f8c8c90d36f00ec85a83e10cabfd1ba31b7c260 WatchSource:0}: Error finding container feb2a33e8eee7d6a74658b127f8c8c90d36f00ec85a83e10cabfd1ba31b7c260: Status 404 returned error can't find the container with id feb2a33e8eee7d6a74658b127f8c8c90d36f00ec85a83e10cabfd1ba31b7c260 Jun 08 13:43:50.079098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.079084 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:43:50.096259 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.096213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"db4f7bac20d99b4a8666a76d42fac6ee","Type":"ContainerStarted","Data":"0bb2db6ac586a02896c42f81ca5215aba8be949fda121ff3ea8c6a386d9d81af"} Jun 08 13:43:50.097069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.097051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" event={"ID":"de5821b4975da9b864744e1cc737bdf4","Type":"ContainerStarted","Data":"feb2a33e8eee7d6a74658b127f8c8c90d36f00ec85a83e10cabfd1ba31b7c260"} Jun 08 13:43:50.113209 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:50.113189 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jun 08 13:43:50.137920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.136668 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:50.154246 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.154226 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:50.220726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.220695 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jun 08 13:43:50.231081 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.231059 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:43:50.232213 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.232199 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jun 08 13:43:50.327110 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.327031 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:43:50.996680 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:50.996630 2576 apiserver.go:52] "Watching apiserver" Jun 08 13:43:51.006605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.006581 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:43:51.007937 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.007915 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-8jnqz","openshift-image-registry/node-ca-zfvqh","openshift-multus/multus-additional-cni-plugins-ln26z","openshift-multus/multus-kc5lr","openshift-multus/network-metrics-daemon-qgk8v","openshift-network-diagnostics/network-check-target-hknq8","kube-system/global-pull-secret-syncer-x988q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4","openshift-cluster-node-tuning-operator/tuned-9rx84","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal","openshift-network-operator/iptables-alerter-p882q","openshift-ovn-kubernetes/ovnkube-node-htmnw","kube-system/konnectivity-agent-cwzbm","kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal"] Jun 08 13:43:51.010560 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.010540 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.010719 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.010610 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:43:51.012661 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.012643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.015092 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.015068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.015368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.015350 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:43:51.015765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.015744 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ls95n\"" Jun 08 13:43:51.015892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.015832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:43:51.017257 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.017645 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.017736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017697 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:43:51.017810 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtgbx\"" Jun 08 13:43:51.017921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017894 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:43:51.018065 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.017958 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:43:51.018065 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.018047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.019444 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.019424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.019552 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.019495 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:43:51.019868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.019800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:43:51.019947 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.019930 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t29sk\"" Jun 08 13:43:51.021194 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.021158 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:51.022244 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.022223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:51.022320 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.022303 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:43:51.024559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.024541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.027007 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.026771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.027739 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.027598 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wn5bl\"" Jun 08 13:43:51.027823 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.027765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.028035 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.027980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.029682 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.029629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.030788 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-k8s-cni-cncf-io\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.030788 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dxq8l\"" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-multus\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-conf-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-kubelet-config\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d82082-df02-4d59-b4b5-e2975a2220dd-konnectivity-ca\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.030935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-multus-certs\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.030975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-daemon-config\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-dbus\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031019 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d82082-df02-4d59-b4b5-e2975a2220dd-agent-certs\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cni-binary-copy\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-etc-kubernetes\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cnibin\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pg6z\" (UniqueName: \"kubernetes.io/projected/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-kube-api-access-9pg6z\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-system-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-bin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-socket-dir-parent\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.031422 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4plr\" (UniqueName: \"kubernetes.io/projected/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-kube-api-access-b4plr\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lxb\" (UniqueName: \"kubernetes.io/projected/a626f4c8-42a1-469d-9153-c9fb92be64eb-kube-api-access-q6lxb\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-os-release\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-netns\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-kubelet\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-hostroot\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cnibin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-os-release\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.031800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.032245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.032229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.033825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.033791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.035832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.035808 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.036010 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.035951 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:43:51.036495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.036465 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.036582 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.036524 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62wpf\"" Jun 08 13:43:51.037085 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.037065 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b7clv\"" Jun 08 13:43:51.037188 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.037172 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.038736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.037560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.038736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.037857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.038855 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.038781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sd679\"" Jun 08 13:43:51.038855 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.038836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:43:51.040011 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.039900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.040174 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.040095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:43:51.040360 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.040301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:43:51.040360 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.040323 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:51.041426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.041341 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:43:51.041599 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.041584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:43:51.042038 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.042018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rpr9z\"" Jun 08 13:43:51.042532 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.042163 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:43:51.042532 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.042264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:43:51.042532 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.042322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:43:51.092378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.092354 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qm9t" Jun 08 13:43:51.106750 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.106720 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qm9t" Jun 08 13:43:51.122162 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.122138 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:43:51.132710 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.132686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d82082-df02-4d59-b4b5-e2975a2220dd-konnectivity-ca\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.132885 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.132868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-sys\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.133048 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/476d4077-1a67-4e55-96a9-f6a2536939f2-serviceca\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.133143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2a4061-2ae0-475f-b970-3763b555b9b7-host-slash\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.133143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-modprobe-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.133143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.133143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5nhm\" (UniqueName: \"kubernetes.io/projected/9e2a4061-2ae0-475f-b970-3763b555b9b7-kube-api-access-k5nhm\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.133344 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-config\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133344 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovn-node-metrics-cert\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133344 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-daemon-config\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133344 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1d82082-df02-4d59-b4b5-e2975a2220dd-konnectivity-ca\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.133344 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-lib-modules\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e2a4061-2ae0-475f-b970-3763b555b9b7-iptables-alerter-script\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-tmp-dir\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cni-binary-copy\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-bin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppd4\" (UniqueName: \"kubernetes.io/projected/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kube-api-access-fppd4\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-os-release\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/476d4077-1a67-4e55-96a9-f6a2536939f2-host\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-bin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-var-lib-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-os-release\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-netns\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-kubelet\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-netns\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-daemon-config\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-netns\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-kubelet\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-ovn\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cni-binary-copy\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.133964 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.133966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-var-lib-kubelet\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-device-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-kubelet\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-log-socket\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-conf-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-conf-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-hosts-file\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-etc-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-multus-certs\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysconfig\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-kubernetes\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-multus-certs\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.134751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-systemd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-bin\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-dbus\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d82082-df02-4d59-b4b5-e2975a2220dd-agent-certs\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-systemd\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-run\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skfdv\" (UniqueName: \"kubernetes.io/projected/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-kube-api-access-skfdv\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-netd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-dbus\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-etc-kubernetes\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-etc-kubernetes\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cnibin\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pg6z\" (UniqueName: \"kubernetes.io/projected/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-kube-api-access-9pg6z\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.135506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-cnibin\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.134857 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tc8t\" (UniqueName: \"kubernetes.io/projected/708e1002-e513-4938-8a5c-02889087de51-kube-api-access-4tc8t\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-slash\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.134937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:43:51.634904006 +0000 UTC m=+2.925420901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-system-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-conf\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.134969 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-system-cni-dir\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsp5\" (UniqueName: \"kubernetes.io/projected/476d4077-1a67-4e55-96a9-f6a2536939f2-kube-api-access-lbsp5\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-socket-dir-parent\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4plr\" (UniqueName: \"kubernetes.io/projected/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-kube-api-access-b4plr\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lxb\" (UniqueName: \"kubernetes.io/projected/a626f4c8-42a1-469d-9153-c9fb92be64eb-kube-api-access-q6lxb\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.136281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-multus-socket-dir-parent\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98h6\" (UniqueName: \"kubernetes.io/projected/ccaa087e-d8c1-4553-a63d-7b7382e92e56-kube-api-access-p98h6\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-hostroot\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-hostroot\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-host\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-etc-tuned\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.135539 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.135611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:43:51.635593688 +0000 UTC m=+2.926110577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-systemd-units\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cnibin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-os-release\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-tmp\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.137143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-node-log\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-env-overrides\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.135982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-os-release\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-script-lib\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-k8s-cni-cncf-io\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-multus\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-cnibin\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-kubelet-config\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-run-k8s-cni-cncf-io\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-host-var-lib-cni-multus\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.138032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.136191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-kubelet-config\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.138527 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.138497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1d82082-df02-4d59-b4b5-e2975a2220dd-agent-certs\") pod \"konnectivity-agent-cwzbm\" (UID: \"c1d82082-df02-4d59-b4b5-e2975a2220dd\") " pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.142695 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.142672 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:51.142797 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.142700 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:51.142797 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.142714 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:51.142797 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.142771 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:51.64275439 +0000 UTC m=+2.933271283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:51.144503 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.144477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pg6z\" (UniqueName: \"kubernetes.io/projected/cd5e3bc8-cebb-4a58-b10a-ece9c11971ff-kube-api-access-9pg6z\") pod \"multus-additional-cni-plugins-ln26z\" (UID: \"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff\") " pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.145079 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.145060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4plr\" (UniqueName: \"kubernetes.io/projected/13a55cd5-e7ae-4ab6-903c-c6cf1c64486f-kube-api-access-b4plr\") pod \"multus-kc5lr\" (UID: \"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f\") " pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.145211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.145095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lxb\" (UniqueName: \"kubernetes.io/projected/a626f4c8-42a1-469d-9153-c9fb92be64eb-kube-api-access-q6lxb\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.237162 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fppd4\" (UniqueName: \"kubernetes.io/projected/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kube-api-access-fppd4\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.237319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/476d4077-1a67-4e55-96a9-f6a2536939f2-host\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.237319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-var-lib-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-var-lib-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/476d4077-1a67-4e55-96a9-f6a2536939f2-host\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-netns\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-ovn\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-var-lib-kubelet\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-run-netns\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-ovn\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-device-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-var-lib-kubelet\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-kubelet\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-device-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-log-socket\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-hosts-file\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-etc-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-etc-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.237571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-log-socket\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-hosts-file\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysconfig\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-kubelet\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-kubernetes\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysconfig\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-systemd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-kubernetes\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237703 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-systemd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-bin\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-run-openvswitch\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-systemd\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-bin\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-run\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-systemd\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skfdv\" (UniqueName: \"kubernetes.io/projected/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-kube-api-access-skfdv\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-run\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.238359 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-netd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tc8t\" (UniqueName: \"kubernetes.io/projected/708e1002-e513-4938-8a5c-02889087de51-kube-api-access-4tc8t\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-slash\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-conf\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsp5\" (UniqueName: \"kubernetes.io/projected/476d4077-1a67-4e55-96a9-f6a2536939f2-kube-api-access-lbsp5\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-slash\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.237973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-cni-netd\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98h6\" (UniqueName: \"kubernetes.io/projected/ccaa087e-d8c1-4553-a63d-7b7382e92e56-kube-api-access-p98h6\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-host\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-etc-tuned\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-systemd-units\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-tmp\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.239271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-node-log\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-env-overrides\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-script-lib\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-sys\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/476d4077-1a67-4e55-96a9-f6a2536939f2-serviceca\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2a4061-2ae0-475f-b970-3763b555b9b7-host-slash\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-conf\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-modprobe-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5nhm\" (UniqueName: \"kubernetes.io/projected/9e2a4061-2ae0-475f-b970-3763b555b9b7-kube-api-access-k5nhm\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-config\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovn-node-metrics-cert\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-lib-modules\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e2a4061-2ae0-475f-b970-3763b555b9b7-iptables-alerter-script\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-tmp-dir\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.240069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-tmp-dir\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.238783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-sys\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/476d4077-1a67-4e55-96a9-f6a2536939f2-serviceca\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-modprobe-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-lib-modules\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-script-lib\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2a4061-2ae0-475f-b970-3763b555b9b7-host-slash\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-systemd-units\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-etc-sysctl-d\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708e1002-e513-4938-8a5c-02889087de51-host\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37979e43-540e-4c42-b1dd-48f19e4c8fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaa087e-d8c1-4553-a63d-7b7382e92e56-node-log\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239580 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovnkube-config\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.239676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e2a4061-2ae0-475f-b970-3763b555b9b7-iptables-alerter-script\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.240920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.240078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaa087e-d8c1-4553-a63d-7b7382e92e56-env-overrides\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.242051 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.242025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-tmp\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.242583 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.242557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaa087e-d8c1-4553-a63d-7b7382e92e56-ovn-node-metrics-cert\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.242864 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.242837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/708e1002-e513-4938-8a5c-02889087de51-etc-tuned\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.246969 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.246913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skfdv\" (UniqueName: \"kubernetes.io/projected/c3645d6b-3f62-47ca-89ed-db4d4620f6f2-kube-api-access-skfdv\") pod \"node-resolver-8jnqz\" (UID: \"c3645d6b-3f62-47ca-89ed-db4d4620f6f2\") " pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.247591 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.247568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsp5\" (UniqueName: \"kubernetes.io/projected/476d4077-1a67-4e55-96a9-f6a2536939f2-kube-api-access-lbsp5\") pod \"node-ca-zfvqh\" (UID: \"476d4077-1a67-4e55-96a9-f6a2536939f2\") " pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.247778 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.247752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppd4\" (UniqueName: \"kubernetes.io/projected/37979e43-540e-4c42-b1dd-48f19e4c8fb9-kube-api-access-fppd4\") pod \"aws-ebs-csi-driver-node-m5ld4\" (UID: \"37979e43-540e-4c42-b1dd-48f19e4c8fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.248110 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.248092 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tc8t\" (UniqueName: \"kubernetes.io/projected/708e1002-e513-4938-8a5c-02889087de51-kube-api-access-4tc8t\") pod \"tuned-9rx84\" (UID: \"708e1002-e513-4938-8a5c-02889087de51\") " pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.248795 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.248771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98h6\" (UniqueName: \"kubernetes.io/projected/ccaa087e-d8c1-4553-a63d-7b7382e92e56-kube-api-access-p98h6\") pod \"ovnkube-node-htmnw\" (UID: \"ccaa087e-d8c1-4553-a63d-7b7382e92e56\") " pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.249163 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.249135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5nhm\" (UniqueName: \"kubernetes.io/projected/9e2a4061-2ae0-475f-b970-3763b555b9b7-kube-api-access-k5nhm\") pod \"iptables-alerter-p882q\" (UID: \"9e2a4061-2ae0-475f-b970-3763b555b9b7\") " pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.296462 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.296428 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:51.324774 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.324740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:43:51.336018 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.335980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ln26z" Jun 08 13:43:51.346679 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.346657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kc5lr" Jun 08 13:43:51.351426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.351407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rx84" Jun 08 13:43:51.358885 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.358866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8jnqz" Jun 08 13:43:51.364379 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.364362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfvqh" Jun 08 13:43:51.371879 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.371860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" Jun 08 13:43:51.378485 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.378470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p882q" Jun 08 13:43:51.384120 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.384103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:43:51.641951 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.641854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:51.641951 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.641920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:51.642169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.641964 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:51.642169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.642050 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:43:52.642029096 +0000 UTC m=+3.932545972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:51.642169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.642062 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:51.642169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.642100 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:43:52.642088298 +0000 UTC m=+3.932605174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:51.742447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:51.742410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:51.742605 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.742546 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:51.742605 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.742574 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:51.742605 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.742586 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:51.742719 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:51.742645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:52.742631144 +0000 UTC m=+4.033148018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:52.054262 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.054148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476d4077_1a67_4e55_96a9_f6a2536939f2.slice/crio-9434ff1f9e399be94655ca63b651c260a7d3a34a670838dde1618d84301b70b7 WatchSource:0}: Error finding container 9434ff1f9e399be94655ca63b651c260a7d3a34a670838dde1618d84301b70b7: Status 404 returned error can't find the container with id 9434ff1f9e399be94655ca63b651c260a7d3a34a670838dde1618d84301b70b7 Jun 08 13:43:52.055288 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.055256 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a55cd5_e7ae_4ab6_903c_c6cf1c64486f.slice/crio-3c28aed7d6ac85082f20337b5f03b7c23a67d99dea6913b7e1b1a80ae33b6919 WatchSource:0}: Error finding container 3c28aed7d6ac85082f20337b5f03b7c23a67d99dea6913b7e1b1a80ae33b6919: Status 404 returned error can't find the container with id 3c28aed7d6ac85082f20337b5f03b7c23a67d99dea6913b7e1b1a80ae33b6919 Jun 08 13:43:52.060245 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.060225 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d82082_df02_4d59_b4b5_e2975a2220dd.slice/crio-3b8f47bd98b659c37c16f127ffe7657c3a5140156c6c7aeac657c79dd3d4a71b WatchSource:0}: Error finding container 3b8f47bd98b659c37c16f127ffe7657c3a5140156c6c7aeac657c79dd3d4a71b: Status 404 returned error can't find the container with id 3b8f47bd98b659c37c16f127ffe7657c3a5140156c6c7aeac657c79dd3d4a71b Jun 08 13:43:52.062411 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.062062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708e1002_e513_4938_8a5c_02889087de51.slice/crio-73931224bb7b29eb7df5a17cf7cc8474b02087d4fa49ba46708de41caeaf9576 WatchSource:0}: Error finding container 73931224bb7b29eb7df5a17cf7cc8474b02087d4fa49ba46708de41caeaf9576: Status 404 returned error can't find the container with id 73931224bb7b29eb7df5a17cf7cc8474b02087d4fa49ba46708de41caeaf9576 Jun 08 13:43:52.063628 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.063371 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaa087e_d8c1_4553_a63d_7b7382e92e56.slice/crio-b0713befb4ec9b72681d3f27057776c75b25982a0f7e1f0358c52b31eccf5bd9 WatchSource:0}: Error finding container b0713befb4ec9b72681d3f27057776c75b25982a0f7e1f0358c52b31eccf5bd9: Status 404 returned error can't find the container with id b0713befb4ec9b72681d3f27057776c75b25982a0f7e1f0358c52b31eccf5bd9 Jun 08 13:43:52.064523 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.063982 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2a4061_2ae0_475f_b970_3763b555b9b7.slice/crio-dc04076dcf186a4af26145d2dfb72dd24186d253af141b1346f2eb9ca6eaef2d WatchSource:0}: Error finding container dc04076dcf186a4af26145d2dfb72dd24186d253af141b1346f2eb9ca6eaef2d: Status 404 returned error can't find the container with id dc04076dcf186a4af26145d2dfb72dd24186d253af141b1346f2eb9ca6eaef2d Jun 08 13:43:52.064784 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.064572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5e3bc8_cebb_4a58_b10a_ece9c11971ff.slice/crio-82d59c84fa85dacc7605a323df6bf50364ea3b5efaded2dcc736fe77277fd626 WatchSource:0}: Error finding container 82d59c84fa85dacc7605a323df6bf50364ea3b5efaded2dcc736fe77277fd626: Status 404 returned error can't find the container with id 82d59c84fa85dacc7605a323df6bf50364ea3b5efaded2dcc736fe77277fd626 Jun 08 13:43:52.066325 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.066073 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37979e43_540e_4c42_b1dd_48f19e4c8fb9.slice/crio-16ad0fb9fc4970a95c4e034e1e75b64b9a883459751c6f7d9bcd203c65f30581 WatchSource:0}: Error finding container 16ad0fb9fc4970a95c4e034e1e75b64b9a883459751c6f7d9bcd203c65f30581: Status 404 returned error can't find the container with id 16ad0fb9fc4970a95c4e034e1e75b64b9a883459751c6f7d9bcd203c65f30581 Jun 08 13:43:52.067112 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:43:52.067091 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3645d6b_3f62_47ca_89ed_db4d4620f6f2.slice/crio-f76befcf2f442327bbec65887bad7afa8e4e93f131feaddc329537e3bf1f4124 WatchSource:0}: Error finding container f76befcf2f442327bbec65887bad7afa8e4e93f131feaddc329537e3bf1f4124: Status 404 returned error can't find the container with id f76befcf2f442327bbec65887bad7afa8e4e93f131feaddc329537e3bf1f4124 Jun 08 13:43:52.093622 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.093597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:52.093710 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.093625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:52.093769 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.093747 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:43:52.093863 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.093844 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:43:52.105750 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.105723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8jnqz" event={"ID":"c3645d6b-3f62-47ca-89ed-db4d4620f6f2","Type":"ContainerStarted","Data":"f76befcf2f442327bbec65887bad7afa8e4e93f131feaddc329537e3bf1f4124"} Jun 08 13:43:52.107066 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.107035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" event={"ID":"37979e43-540e-4c42-b1dd-48f19e4c8fb9","Type":"ContainerStarted","Data":"16ad0fb9fc4970a95c4e034e1e75b64b9a883459751c6f7d9bcd203c65f30581"} Jun 08 13:43:52.108439 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.108417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwzbm" event={"ID":"c1d82082-df02-4d59-b4b5-e2975a2220dd","Type":"ContainerStarted","Data":"3b8f47bd98b659c37c16f127ffe7657c3a5140156c6c7aeac657c79dd3d4a71b"} Jun 08 13:43:52.109568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.109542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfvqh" event={"ID":"476d4077-1a67-4e55-96a9-f6a2536939f2","Type":"ContainerStarted","Data":"9434ff1f9e399be94655ca63b651c260a7d3a34a670838dde1618d84301b70b7"} Jun 08 13:43:52.109670 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.109637 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:51 +0000 UTC" deadline="2027-12-18 03:40:28.125764771 +0000 UTC" Jun 08 13:43:52.109739 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.109670 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13381h56m36.016096808s" Jun 08 13:43:52.111188 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.111156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerStarted","Data":"82d59c84fa85dacc7605a323df6bf50364ea3b5efaded2dcc736fe77277fd626"} Jun 08 13:43:52.113876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.112723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p882q" event={"ID":"9e2a4061-2ae0-475f-b970-3763b555b9b7","Type":"ContainerStarted","Data":"dc04076dcf186a4af26145d2dfb72dd24186d253af141b1346f2eb9ca6eaef2d"} Jun 08 13:43:52.115334 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.115308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"b0713befb4ec9b72681d3f27057776c75b25982a0f7e1f0358c52b31eccf5bd9"} Jun 08 13:43:52.117324 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.117302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rx84" event={"ID":"708e1002-e513-4938-8a5c-02889087de51","Type":"ContainerStarted","Data":"73931224bb7b29eb7df5a17cf7cc8474b02087d4fa49ba46708de41caeaf9576"} Jun 08 13:43:52.118425 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.118404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kc5lr" event={"ID":"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f","Type":"ContainerStarted","Data":"3c28aed7d6ac85082f20337b5f03b7c23a67d99dea6913b7e1b1a80ae33b6919"} Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.650020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.650064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.650177 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.650229 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:43:54.650212479 +0000 UTC m=+5.940729353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.650585 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:52.650652 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.650621 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:43:54.650610866 +0000 UTC m=+5.941127740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:52.751379 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:52.750792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:52.751379 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.750976 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:52.751379 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.751011 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:52.751379 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.751027 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:52.751379 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:52.751085 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:54.75106562 +0000 UTC m=+6.041582498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:53.095650 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.094127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:53.095650 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:53.094262 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:43:53.110361 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.110301 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:51 +0000 UTC" deadline="2028-02-08 19:01:05.230677059 +0000 UTC" Jun 08 13:43:53.110361 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.110332 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14645h17m12.120350199s" Jun 08 13:43:53.134707 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.134113 2576 generic.go:356] "Generic (PLEG): container finished" podID="db4f7bac20d99b4a8666a76d42fac6ee" containerID="f717250bee72e3a9a419eb8949a41a37f2c40e1cda71e772e32fb8732c1c0c88" exitCode=0 Jun 08 13:43:53.134707 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.134391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"db4f7bac20d99b4a8666a76d42fac6ee","Type":"ContainerDied","Data":"f717250bee72e3a9a419eb8949a41a37f2c40e1cda71e772e32fb8732c1c0c88"} Jun 08 13:43:53.142588 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:53.142100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" event={"ID":"de5821b4975da9b864744e1cc737bdf4","Type":"ContainerStarted","Data":"41c8ca1e8b3b6b4f58755dfcb908ce84013d556eb7583940ff87db9be424c7ec"} Jun 08 13:43:54.093260 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.093229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:54.093476 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.093366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:43:54.094031 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.093736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:54.094031 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.093834 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:43:54.156264 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.156223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"db4f7bac20d99b4a8666a76d42fac6ee","Type":"ContainerStarted","Data":"a0435531e9371f7720d92a315827e048dc2b3fda3ff434652a0837411c18f434"} Jun 08 13:43:54.171434 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.171376 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" podStartSLOduration=4.171354996 podStartE2EDuration="4.171354996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:53.165366237 +0000 UTC m=+4.455883137" watchObservedRunningTime="2026-06-08 13:43:54.171354996 +0000 UTC m=+5.461871895" Jun 08 13:43:54.666901 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.666862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:54.667085 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.666923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:54.667162 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.667123 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:54.667215 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.667188 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:43:58.667168255 +0000 UTC m=+9.957685138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:54.667642 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.667623 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:54.667713 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.667683 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:43:58.667668342 +0000 UTC m=+9.958185223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:54.768616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:54.767947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:54.768616 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.768126 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:54.768616 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.768148 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:54.768616 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.768161 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:54.768616 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:54.768228 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:58.768209421 +0000 UTC m=+10.058726299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:55.096229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:55.096128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:55.096419 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:55.096378 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:43:56.093776 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:56.093741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:56.094258 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:56.093875 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:43:56.094315 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:56.094286 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:56.094696 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:56.094387 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:43:57.095571 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:57.095539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:57.096045 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:57.095654 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:43:58.093820 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:58.093081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:58.093820 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:58.093163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:58.093820 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.093310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:43:58.093820 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.093770 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:43:58.706853 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:58.706814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:43:58.707305 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:58.706919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:43:58.707305 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.707007 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:58.707305 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.707045 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:58.707305 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.707071 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:44:06.70705376 +0000 UTC m=+17.997570636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:58.707305 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.707103 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:44:06.707084366 +0000 UTC m=+17.997601247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:58.808049 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:58.808009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:58.808242 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.808196 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:58.808242 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.808216 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:58.808242 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.808229 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:58.808409 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:58.808288 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:06.808268382 +0000 UTC m=+18.098785276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:59.094410 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:43:59.094323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:43:59.094553 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:43:59.094439 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:00.093869 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:00.093831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:00.093869 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:00.093867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:00.094458 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:00.093979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:00.094458 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:00.094113 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:01.093845 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:01.093813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:01.094033 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:01.093940 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:02.093255 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:02.093217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:02.093656 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:02.093217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:02.093656 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:02.093356 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:02.093656 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:02.093416 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:03.093755 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:03.093715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:03.094170 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:03.093882 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:04.094008 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:04.093954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:04.094456 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:04.094122 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:04.094456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:04.094174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:04.094456 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:04.094299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:05.093667 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:05.093631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:05.093858 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:05.093750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:06.093179 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:06.093139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:06.093797 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:06.093185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:06.093797 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.093290 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:06.093797 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.093429 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:06.767251 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:06.767216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:06.767411 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:06.767260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:06.767411 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.767354 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:06.767411 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.767377 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:06.767411 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.767409 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:44:22.767394357 +0000 UTC m=+34.057911231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:06.767573 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.767432 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:44:22.76741441 +0000 UTC m=+34.057931286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:06.868409 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:06.868377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:06.868551 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.868505 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:44:06.868551 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.868519 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:44:06.868551 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.868529 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:06.868670 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:06.868579 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:22.868564775 +0000 UTC m=+34.159081650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:07.093504 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:07.093464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:07.093969 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:07.093608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:08.093986 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:08.093948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:08.094490 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:08.094091 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:08.094490 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:08.094155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:08.094490 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:08.094261 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:09.094460 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:09.094432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:09.094862 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:09.094540 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:10.093436 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:10.093408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:10.093629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:10.093412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:10.093629 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:10.093525 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:10.093629 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:10.093621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:11.096386 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:11.096098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:11.096386 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:11.096219 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:12.094263 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.093944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:12.094407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.094008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:12.094407 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:12.094348 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:12.094495 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:12.094411 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:12.208967 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.208934 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="22c4fb7b9b0ca7aadad93232c548b880bd88833d7713a564ae8ed69496a79577" exitCode=0 Jun 08 13:44:12.209692 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.209016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"22c4fb7b9b0ca7aadad93232c548b880bd88833d7713a564ae8ed69496a79577"} Jun 08 13:44:12.212375 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"da8ddf8775f15b3a873174d029d63b2f20d4710af5da357b6a12d1acc83009a3"} Jun 08 13:44:12.212469 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"a91d157640330e89b6e8e753c0e2d06a1f703f1c55fd542de3af28247ab5d4e9"} Jun 08 13:44:12.212469 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"47606512c7816e9a11eeb882ec181b0a044ee1069a06ed62c25e9a51a3781014"} Jun 08 13:44:12.212576 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"32e5a8f175f82d7da1c5bde4ccf946e50d753daf2ef7ef9db2266fa089566341"} Jun 08 13:44:12.212576 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"0b00613c90cced17f53c576d2a39f82d15c353624058f461d3ecae951c3e323a"} Jun 08 13:44:12.212576 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.212524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"ac90e3731e49a62b30bab397adbece7c4a730188a9a81b34a2af73225905fe87"} Jun 08 13:44:12.213726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.213704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rx84" event={"ID":"708e1002-e513-4938-8a5c-02889087de51","Type":"ContainerStarted","Data":"fb66b15d4b80e0c7c1448f08f0896e984c8b78004f6a829feea0bd1fb37a3b5c"} Jun 08 13:44:12.215053 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.215033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kc5lr" event={"ID":"13a55cd5-e7ae-4ab6-903c-c6cf1c64486f","Type":"ContainerStarted","Data":"eba20fff5e51cf76c2d1e44e3776418533b8ca322d804f5ade18595a9ddf12ac"} Jun 08 13:44:12.216938 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.216917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8jnqz" event={"ID":"c3645d6b-3f62-47ca-89ed-db4d4620f6f2","Type":"ContainerStarted","Data":"5c654031d46a24ae97c403af807270dc62c1f1b01b88291d9216ca39fa3bbd64"} Jun 08 13:44:12.218195 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.218172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" event={"ID":"37979e43-540e-4c42-b1dd-48f19e4c8fb9","Type":"ContainerStarted","Data":"e1517fef5fa86589d00ba34d9b37e41c48c870390a630bfb796956a79572ae5d"} Jun 08 13:44:12.219526 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.219501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwzbm" event={"ID":"c1d82082-df02-4d59-b4b5-e2975a2220dd","Type":"ContainerStarted","Data":"1937bb89d1ab48c48552f950977d3527b65abbdb82a8a0e20920683b2216d7d5"} Jun 08 13:44:12.220803 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.220778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfvqh" event={"ID":"476d4077-1a67-4e55-96a9-f6a2536939f2","Type":"ContainerStarted","Data":"8c9f13d89ba546ea3f8c53a094a7eabfa363755d71e218377bb5c08474b37b70"} Jun 08 13:44:12.277834 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.277785 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" podStartSLOduration=22.277769565 podStartE2EDuration="22.277769565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:54.172542283 +0000 UTC m=+5.463059182" watchObservedRunningTime="2026-06-08 13:44:12.277769565 +0000 UTC m=+23.568286461" Jun 08 13:44:12.308773 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.308726 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9rx84" podStartSLOduration=4.291066085 podStartE2EDuration="23.308711884s" totalImagesPullingTime="19.017645799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:12.307762901 +0000 UTC m=+23.598279799" watchObservedRunningTime="2026-06-08 13:44:12.308711884 +0000 UTC m=+23.599228780" Jun 08 13:44:12.338440 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.338392 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfvqh" podStartSLOduration=4.31518215 podStartE2EDuration="23.338378787s" totalImagesPullingTime="19.023196637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:12.337805683 +0000 UTC m=+23.628322579" watchObservedRunningTime="2026-06-08 13:44:12.338378787 +0000 UTC m=+23.628895684" Jun 08 13:44:12.353811 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.353732 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cwzbm" podStartSLOduration=8.784123744 podStartE2EDuration="23.353719032s" totalImagesPullingTime="14.569595288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:12.353183242 +0000 UTC m=+23.643700138" watchObservedRunningTime="2026-06-08 13:44:12.353719032 +0000 UTC m=+23.644235929" Jun 08 13:44:12.374582 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.374530 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kc5lr" podStartSLOduration=4.3035062459999995 podStartE2EDuration="23.374512998s" totalImagesPullingTime="19.071006752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:12.373766743 +0000 UTC m=+23.664283640" watchObservedRunningTime="2026-06-08 13:44:12.374512998 +0000 UTC m=+23.665029895" Jun 08 13:44:12.394547 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.394502 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8jnqz" podStartSLOduration=4.386691899 podStartE2EDuration="23.394487828s" totalImagesPullingTime="19.007795929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:12.394270774 +0000 UTC m=+23.684787670" watchObservedRunningTime="2026-06-08 13:44:12.394487828 +0000 UTC m=+23.685004725" Jun 08 13:44:12.546394 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.546369 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:44:12.566720 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:12.566699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8jnqz_c3645d6b-3f62-47ca-89ed-db4d4620f6f2/dns-node-resolver/0.log" Jun 08 13:44:13.095461 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.095427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:13.095741 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:13.095556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:13.102828 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.102714 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:44:12.546384485Z","UUID":"e9cbf4b1-9628-4269-90ab-ebc0b676bdc1","Handler":null,"Name":"","Endpoint":""} Jun 08 13:44:13.104667 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.104646 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:44:13.104785 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.104692 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:44:13.221408 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.221157 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:44:13.221926 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.221763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:44:13.225120 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.225090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p882q" event={"ID":"9e2a4061-2ae0-475f-b970-3763b555b9b7","Type":"ContainerStarted","Data":"6cecabe1b2a870f012b3ea90143a0c5539a38a162c90dceaf4b9fed963726388"} Jun 08 13:44:13.228331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.228302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" event={"ID":"37979e43-540e-4c42-b1dd-48f19e4c8fb9","Type":"ContainerStarted","Data":"735ff8cfd1b272a570d02ca5a986ce0a2e7e4f501c453e0e2d18162a9a8ea4b3"} Jun 08 13:44:13.229931 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.229909 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:44:13.230429 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.230409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cwzbm" Jun 08 13:44:13.260051 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.259981 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p882q" podStartSLOduration=5.249703913 podStartE2EDuration="24.25996445s" totalImagesPullingTime="19.010260537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:13.259485931 +0000 UTC m=+24.550002828" watchObservedRunningTime="2026-06-08 13:44:13.25996445 +0000 UTC m=+24.550481348" Jun 08 13:44:13.726516 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:13.726475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfvqh_476d4077-1a67-4e55-96a9-f6a2536939f2/node-ca/0.log" Jun 08 13:44:14.094136 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:14.093882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:14.094276 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:14.093893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:14.094276 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:14.094188 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:14.094276 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:14.094248 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:14.234549 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:14.234506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"6c409944d7c1ae77f05020ba68dbe0dc6a8b27fe1e8314f17d717ee0180036c0"} Jun 08 13:44:14.237068 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:14.237036 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" event={"ID":"37979e43-540e-4c42-b1dd-48f19e4c8fb9","Type":"ContainerStarted","Data":"60190063876a55abaa61b8efbcb6a71b8421f600b8429c7e8f5dd6a240945b93"} Jun 08 13:44:14.257234 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:14.257172 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5ld4" podStartSLOduration=4.170308755 podStartE2EDuration="25.257157249s" totalImagesPullingTime="21.086848494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:14.256814462 +0000 UTC m=+25.547331372" watchObservedRunningTime="2026-06-08 13:44:14.257157249 +0000 UTC m=+25.547674164" Jun 08 13:44:15.093388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:15.093355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:15.093601 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:15.093479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:16.093606 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:16.093575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:16.094112 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:16.093611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:16.094112 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:16.093689 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:16.094112 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:16.093849 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:17.094270 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.093972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:17.094810 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:17.094346 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:17.246891 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.246859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" event={"ID":"ccaa087e-d8c1-4553-a63d-7b7382e92e56","Type":"ContainerStarted","Data":"bb946202b70fc3194faee0b4df10558e2ab35b658ed18f10c6d51d3ac66f2446"} Jun 08 13:44:17.247208 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.247184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:17.248773 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.248747 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="e0be74d9318594bc2779aa15a22a9bf6d0cfb5db743ef8605d08a13f0c79c154" exitCode=0 Jun 08 13:44:17.248887 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.248788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"e0be74d9318594bc2779aa15a22a9bf6d0cfb5db743ef8605d08a13f0c79c154"} Jun 08 13:44:17.264942 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.264919 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:17.287501 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:17.287463 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" podStartSLOduration=9.205260095 podStartE2EDuration="28.287450682s" totalImagesPullingTime="19.082190587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:17.286903347 +0000 UTC m=+28.577420313" watchObservedRunningTime="2026-06-08 13:44:17.287450682 +0000 UTC m=+28.577967576" Jun 08 13:44:18.093838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:18.093804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:18.093838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:18.093824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:18.094169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:18.093921 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:18.094169 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:18.094074 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:18.252031 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:18.251983 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:18.252413 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:18.252098 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:18.267502 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:18.267474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:19.097020 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:19.094866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:19.097020 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:19.095013 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:19.255863 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:19.255825 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="c07989c84b533e1de84bae68509f042c166c15080298882a209f190e8a8342e2" exitCode=0 Jun 08 13:44:19.256292 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:19.255919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"c07989c84b533e1de84bae68509f042c166c15080298882a209f190e8a8342e2"} Jun 08 13:44:20.094148 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:20.094114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:20.094297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:20.094120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:20.094297 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:20.094221 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:20.094381 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:20.094320 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:21.093454 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:21.093416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:21.093939 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:21.093513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:21.262811 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:21.262773 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="0a6123b3243e1bf0c25ca3cc474bfc5fcd61ad86f7c220f2721fb0a5db720d16" exitCode=0 Jun 08 13:44:21.262942 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:21.262835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"0a6123b3243e1bf0c25ca3cc474bfc5fcd61ad86f7c220f2721fb0a5db720d16"} Jun 08 13:44:22.093935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:22.093898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:22.094384 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:22.093898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:22.094384 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.094063 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:22.094384 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.094103 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:22.791085 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:22.791050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:22.791238 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:22.791124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:22.791238 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.791218 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:22.791238 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.791221 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:22.791393 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.791279 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret podName:03abd6b8-4546-4b13-9e40-fe59b2cf3b2d nodeName:}" failed. No retries permitted until 2026-06-08 13:44:54.791261601 +0000 UTC m=+66.081778478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret") pod "global-pull-secret-syncer-x988q" (UID: "03abd6b8-4546-4b13-9e40-fe59b2cf3b2d") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:22.791393 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.791297 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs podName:a626f4c8-42a1-469d-9153-c9fb92be64eb nodeName:}" failed. No retries permitted until 2026-06-08 13:44:54.791287441 +0000 UTC m=+66.081804316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs") pod "network-metrics-daemon-qgk8v" (UID: "a626f4c8-42a1-469d-9153-c9fb92be64eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:22.892159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:22.892116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:22.892336 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.892287 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:44:22.892336 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.892306 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:44:22.892336 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.892316 2576 projected.go:196] Error preparing data for projected volume kube-api-access-h9msg for pod openshift-network-diagnostics/network-check-target-hknq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:22.892473 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:22.892379 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg podName:1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:54.892361423 +0000 UTC m=+66.182878300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9msg" (UniqueName: "kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg") pod "network-check-target-hknq8" (UID: "1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:23.094105 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:23.094023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:23.094594 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:23.094138 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:24.094094 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:24.094064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:24.094276 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:24.094074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:24.094276 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:24.094185 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:24.094664 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:24.094275 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:25.093613 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:25.093580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:25.093766 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:25.093692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:25.275209 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:25.275174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerStarted","Data":"483f512243ebf5549916146f52b49de36b49f442ed9dfa7794b1341cb3f1a279"} Jun 08 13:44:26.094094 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:26.094058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:26.094270 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:26.094058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:26.094270 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:26.094183 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:26.094393 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:26.094274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:26.279938 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:26.279903 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="483f512243ebf5549916146f52b49de36b49f442ed9dfa7794b1341cb3f1a279" exitCode=0 Jun 08 13:44:26.280350 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:26.279967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"483f512243ebf5549916146f52b49de36b49f442ed9dfa7794b1341cb3f1a279"} Jun 08 13:44:27.094056 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:27.094018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:27.094247 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:27.094128 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:27.286385 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:27.286350 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd5e3bc8-cebb-4a58-b10a-ece9c11971ff" containerID="05dd3c28ceb2e217f8967f24c544c155192ab4f09615c4d0c421e611e89ec316" exitCode=0 Jun 08 13:44:27.286765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:27.286415 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerDied","Data":"05dd3c28ceb2e217f8967f24c544c155192ab4f09615c4d0c421e611e89ec316"} Jun 08 13:44:28.094120 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:28.094086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:28.094302 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:28.094086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:28.094302 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:28.094200 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:28.094382 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:28.094299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:28.294336 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:28.294298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ln26z" event={"ID":"cd5e3bc8-cebb-4a58-b10a-ece9c11971ff","Type":"ContainerStarted","Data":"a5d87b79fd3df3aad95057b1aaa2fa3b3942745eeb9b0cf1b6551509b0d0b74f"} Jun 08 13:44:28.331276 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:28.331228 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ln26z" podStartSLOduration=10.049272587 podStartE2EDuration="39.331214599s" totalImagesPullingTime="29.281942012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:28.330797182 +0000 UTC m=+39.621314078" watchObservedRunningTime="2026-06-08 13:44:28.331214599 +0000 UTC m=+39.621731502" Jun 08 13:44:29.094541 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:29.094505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:29.094723 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:29.094611 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:30.093648 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:30.093619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:30.094068 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:30.093723 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:30.094068 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:30.093782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:30.094068 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:30.093877 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:31.093555 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:31.093522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:31.093747 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:31.093631 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:32.093946 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:32.093909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:32.094386 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:32.094047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:32.094386 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:32.094115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:32.094386 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:32.094231 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:33.094082 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:33.094046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:33.094467 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:33.094147 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:34.093864 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:34.093827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:34.094198 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:34.093827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:34.094198 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:34.093963 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:34.094198 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:34.094068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:35.093620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:35.093584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:35.093817 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:35.093692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:36.093827 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.093800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:36.094206 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:36.093901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:36.094206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.093977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:36.094206 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:36.094083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:36.787640 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.787609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qgk8v"] Jun 08 13:44:36.787807 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.787731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:36.787875 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:36.787849 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:36.792435 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.792388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hknq8"] Jun 08 13:44:36.792694 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.792658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:36.792816 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:36.792763 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:36.793288 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.793257 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x988q"] Jun 08 13:44:36.793401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:36.793346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:36.793460 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:36.793434 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:38.093686 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:38.093655 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:38.093686 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:38.093669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:38.094523 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:38.093755 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:38.094523 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:38.093874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:39.094548 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:39.094508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:39.094983 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:39.094625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x988q" podUID="03abd6b8-4546-4b13-9e40-fe59b2cf3b2d" Jun 08 13:44:40.093675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:40.093489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:40.093866 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:40.093491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:40.093866 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:40.093741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hknq8" podUID="1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2" Jun 08 13:44:40.093968 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:40.093856 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qgk8v" podUID="a626f4c8-42a1-469d-9153-c9fb92be64eb" Jun 08 13:44:41.032125 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.032094 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeReady" Jun 08 13:44:41.032496 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.032207 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:44:41.075660 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.075632 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bz69m"] Jun 08 13:44:41.095098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.095072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.097898 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.097876 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:44:41.098397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.098374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cfkx\"" Jun 08 13:44:41.098509 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.098382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:44:41.098808 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.098790 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-prcvg"] Jun 08 13:44:41.098904 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.098889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:41.101819 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.101795 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:44:41.122947 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.122923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bz69m"] Jun 08 13:44:41.123052 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.122953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-prcvg"] Jun 08 13:44:41.123092 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.123050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.124506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.124484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2879e-5c5f-462b-a76a-f76c18e219fc-config-volume\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.124598 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.124524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f2879e-5c5f-462b-a76a-f76c18e219fc-metrics-tls\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.124598 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.124586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94q7r\" (UniqueName: \"kubernetes.io/projected/c8f2879e-5c5f-462b-a76a-f76c18e219fc-kube-api-access-94q7r\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.124673 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.124609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f2879e-5c5f-462b-a76a-f76c18e219fc-tmp-dir\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.125654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.125639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:44:41.125713 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.125640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:44:41.125769 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.125758 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:44:41.125905 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.125888 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:44:41.125948 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.125914 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzzjv\"" Jun 08 13:44:41.179915 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.179887 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cfxt4"] Jun 08 13:44:41.198821 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.198798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfxt4"] Jun 08 13:44:41.198969 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.198900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.202089 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.202070 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:44:41.202416 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.202399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zjvk2\"" Jun 08 13:44:41.202684 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.202671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:44:41.203274 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.203261 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:44:41.225084 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2879e-5c5f-462b-a76a-f76c18e219fc-config-volume\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.225202 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgwq\" (UniqueName: \"kubernetes.io/projected/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-api-access-zbgwq\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.225202 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jhdl\" (UniqueName: \"kubernetes.io/projected/3089123b-2427-4b9c-82cb-9be2a3d3748a-kube-api-access-4jhdl\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.225202 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f2879e-5c5f-462b-a76a-f76c18e219fc-metrics-tls\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.225339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab09ec84-bcce-4ec7-9243-06743a2b454c-data-volume\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.225339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab09ec84-bcce-4ec7-9243-06743a2b454c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.225339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab09ec84-bcce-4ec7-9243-06743a2b454c-crio-socket\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.225339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3089123b-2427-4b9c-82cb-9be2a3d3748a-cert\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.225485 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94q7r\" (UniqueName: \"kubernetes.io/projected/c8f2879e-5c5f-462b-a76a-f76c18e219fc-kube-api-access-94q7r\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.225485 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f2879e-5c5f-462b-a76a-f76c18e219fc-tmp-dir\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.225485 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.225631 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225618 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2879e-5c5f-462b-a76a-f76c18e219fc-config-volume\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.225745 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.225725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f2879e-5c5f-462b-a76a-f76c18e219fc-tmp-dir\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.229233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.229217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8f2879e-5c5f-462b-a76a-f76c18e219fc-metrics-tls\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.242737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.242718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94q7r\" (UniqueName: \"kubernetes.io/projected/c8f2879e-5c5f-462b-a76a-f76c18e219fc-kube-api-access-94q7r\") pod \"dns-default-bz69m\" (UID: \"c8f2879e-5c5f-462b-a76a-f76c18e219fc\") " pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.325919 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.325842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgwq\" (UniqueName: \"kubernetes.io/projected/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-api-access-zbgwq\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.325919 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.325877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jhdl\" (UniqueName: \"kubernetes.io/projected/3089123b-2427-4b9c-82cb-9be2a3d3748a-kube-api-access-4jhdl\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.325919 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.325900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab09ec84-bcce-4ec7-9243-06743a2b454c-data-volume\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326148 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.325938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab09ec84-bcce-4ec7-9243-06743a2b454c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326148 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab09ec84-bcce-4ec7-9243-06743a2b454c-crio-socket\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326236 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3089123b-2427-4b9c-82cb-9be2a3d3748a-cert\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.326285 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326285 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab09ec84-bcce-4ec7-9243-06743a2b454c-crio-socket\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326366 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab09ec84-bcce-4ec7-9243-06743a2b454c-data-volume\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.326801 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.326776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.328576 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.328556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab09ec84-bcce-4ec7-9243-06743a2b454c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.328721 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.328703 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3089123b-2427-4b9c-82cb-9be2a3d3748a-cert\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.334836 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.334810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgwq\" (UniqueName: \"kubernetes.io/projected/ab09ec84-bcce-4ec7-9243-06743a2b454c-kube-api-access-zbgwq\") pod \"insights-runtime-extractor-prcvg\" (UID: \"ab09ec84-bcce-4ec7-9243-06743a2b454c\") " pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.334976 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.334954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jhdl\" (UniqueName: \"kubernetes.io/projected/3089123b-2427-4b9c-82cb-9be2a3d3748a-kube-api-access-4jhdl\") pod \"ingress-canary-cfxt4\" (UID: \"3089123b-2427-4b9c-82cb-9be2a3d3748a\") " pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.406883 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.406845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:41.431315 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.431287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-prcvg" Jun 08 13:44:41.507272 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.507240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfxt4" Jun 08 13:44:41.619503 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.619473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-prcvg"] Jun 08 13:44:41.622983 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:41.622955 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab09ec84_bcce_4ec7_9243_06743a2b454c.slice/crio-987b69abd1c80670b1535c1c1220c08f69bcc228f635ea38519de12ddfd0ead3 WatchSource:0}: Error finding container 987b69abd1c80670b1535c1c1220c08f69bcc228f635ea38519de12ddfd0ead3: Status 404 returned error can't find the container with id 987b69abd1c80670b1535c1c1220c08f69bcc228f635ea38519de12ddfd0ead3 Jun 08 13:44:41.629416 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.629388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bz69m"] Jun 08 13:44:41.632887 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:41.632858 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f2879e_5c5f_462b_a76a_f76c18e219fc.slice/crio-570da6be712ab200bf19bd06a5313184c7990680f13b2236f99ebdd2da82e7f8 WatchSource:0}: Error finding container 570da6be712ab200bf19bd06a5313184c7990680f13b2236f99ebdd2da82e7f8: Status 404 returned error can't find the container with id 570da6be712ab200bf19bd06a5313184c7990680f13b2236f99ebdd2da82e7f8 Jun 08 13:44:41.672530 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:41.672504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfxt4"] Jun 08 13:44:41.675887 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:41.675867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3089123b_2427_4b9c_82cb_9be2a3d3748a.slice/crio-27f7c197274a70ebccd044ebff508eeeff558a6507b8785c06d3b85cd4b4e29d WatchSource:0}: Error finding container 27f7c197274a70ebccd044ebff508eeeff558a6507b8785c06d3b85cd4b4e29d: Status 404 returned error can't find the container with id 27f7c197274a70ebccd044ebff508eeeff558a6507b8785c06d3b85cd4b4e29d Jun 08 13:44:42.093646 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.093614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:42.094085 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.093741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:42.098350 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.098324 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96pfm\"" Jun 08 13:44:42.098474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.098360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:44:42.098474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.098384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-229wc\"" Jun 08 13:44:42.098474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.098385 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:44:42.098474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.098313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:44:42.239435 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.239386 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q"] Jun 08 13:44:42.259679 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.259651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q"] Jun 08 13:44:42.259827 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.259756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:42.263305 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.263277 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 13:44:42.264082 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.264057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l7dr9\"" Jun 08 13:44:42.325495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.325454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz69m" event={"ID":"c8f2879e-5c5f-462b-a76a-f76c18e219fc","Type":"ContainerStarted","Data":"570da6be712ab200bf19bd06a5313184c7990680f13b2236f99ebdd2da82e7f8"} Jun 08 13:44:42.326924 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.326895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfxt4" event={"ID":"3089123b-2427-4b9c-82cb-9be2a3d3748a","Type":"ContainerStarted","Data":"27f7c197274a70ebccd044ebff508eeeff558a6507b8785c06d3b85cd4b4e29d"} Jun 08 13:44:42.328691 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.328606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prcvg" event={"ID":"ab09ec84-bcce-4ec7-9243-06743a2b454c","Type":"ContainerStarted","Data":"75061b3291eceb202a344c04417350bc86d1462a87d26afdd9eb0ff309a4e983"} Jun 08 13:44:42.328691 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.328656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prcvg" event={"ID":"ab09ec84-bcce-4ec7-9243-06743a2b454c","Type":"ContainerStarted","Data":"987b69abd1c80670b1535c1c1220c08f69bcc228f635ea38519de12ddfd0ead3"} Jun 08 13:44:42.334282 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.334255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mdg2q\" (UID: \"626f7cf8-a468-409f-a01d-8f26eb739133\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:42.435912 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.435477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mdg2q\" (UID: \"626f7cf8-a468-409f-a01d-8f26eb739133\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:42.435912 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:42.435618 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:44:42.435912 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:42.435685 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates podName:626f7cf8-a468-409f-a01d-8f26eb739133 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:42.93566498 +0000 UTC m=+54.226181875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-mdg2q" (UID: "626f7cf8-a468-409f-a01d-8f26eb739133") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:44:42.938490 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.938421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mdg2q\" (UID: \"626f7cf8-a468-409f-a01d-8f26eb739133\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:42.942876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:42.942851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/626f7cf8-a468-409f-a01d-8f26eb739133-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mdg2q\" (UID: \"626f7cf8-a468-409f-a01d-8f26eb739133\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:43.174090 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:43.174056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:43.333357 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:43.333281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prcvg" event={"ID":"ab09ec84-bcce-4ec7-9243-06743a2b454c","Type":"ContainerStarted","Data":"34ad66c75f0987a8dc0cb802f2b37702887bb3f456b02ebc8203c0f853d7a5f7"} Jun 08 13:44:44.812279 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:44.812061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q"] Jun 08 13:44:44.822840 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:44.822792 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626f7cf8_a468_409f_a01d_8f26eb739133.slice/crio-1d404d805deb467784510ed37672fb50ccc47f04b1844a8364ba84970119f24d WatchSource:0}: Error finding container 1d404d805deb467784510ed37672fb50ccc47f04b1844a8364ba84970119f24d: Status 404 returned error can't find the container with id 1d404d805deb467784510ed37672fb50ccc47f04b1844a8364ba84970119f24d Jun 08 13:44:45.341429 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.341385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfxt4" event={"ID":"3089123b-2427-4b9c-82cb-9be2a3d3748a","Type":"ContainerStarted","Data":"510f8993f32aadf59391933a771f473e8bfdc2bc5fdd4c852668b5f979e2ecc3"} Jun 08 13:44:45.343875 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.343842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prcvg" event={"ID":"ab09ec84-bcce-4ec7-9243-06743a2b454c","Type":"ContainerStarted","Data":"f767ead0eb49904ace520e6e8114c1207727e636d0bd90e808d0ac295e82d473"} Jun 08 13:44:45.346041 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.346013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz69m" event={"ID":"c8f2879e-5c5f-462b-a76a-f76c18e219fc","Type":"ContainerStarted","Data":"d8a9a7dc44541464d253a10bf4cd346b70038695c008b1c42e2bc453056f380c"} Jun 08 13:44:45.346175 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.346075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:45.346175 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.346102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz69m" event={"ID":"c8f2879e-5c5f-462b-a76a-f76c18e219fc","Type":"ContainerStarted","Data":"96ded1369c681dbb743a512902b86de776c0ab6ba0860704982bb4cb79432186"} Jun 08 13:44:45.347294 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.347272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" event={"ID":"626f7cf8-a468-409f-a01d-8f26eb739133","Type":"ContainerStarted","Data":"1d404d805deb467784510ed37672fb50ccc47f04b1844a8364ba84970119f24d"} Jun 08 13:44:45.376521 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.376466 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cfxt4" podStartSLOduration=1.387434707 podStartE2EDuration="4.376445351s" totalImagesPullingTime="2.989010644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:45.375725957 +0000 UTC m=+56.666242855" watchObservedRunningTime="2026-06-08 13:44:45.376445351 +0000 UTC m=+56.666962241" Jun 08 13:44:45.396928 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:45.396855 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bz69m" podStartSLOduration=1.364843969 podStartE2EDuration="4.396834589s" totalImagesPullingTime="3.03199062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:45.395689307 +0000 UTC m=+56.686206231" watchObservedRunningTime="2026-06-08 13:44:45.396834589 +0000 UTC m=+56.687351486" Jun 08 13:44:46.352331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:46.352294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" event={"ID":"626f7cf8-a468-409f-a01d-8f26eb739133","Type":"ContainerStarted","Data":"6a43e99a3b38bcdc3a43697d29463e9e4536cbea6409ea8a307b34d8c17d81d6"} Jun 08 13:44:46.368083 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:46.368039 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-prcvg" podStartSLOduration=2.464728849 podStartE2EDuration="5.368022237s" totalImagesPullingTime="2.903293388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:45.415941004 +0000 UTC m=+56.706457901" watchObservedRunningTime="2026-06-08 13:44:46.368022237 +0000 UTC m=+57.658539132" Jun 08 13:44:46.368212 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:46.368147 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" podStartSLOduration=3.364436023 podStartE2EDuration="4.368141403s" totalImagesPullingTime="1.00370538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:46.367246345 +0000 UTC m=+57.657763245" watchObservedRunningTime="2026-06-08 13:44:46.368141403 +0000 UTC m=+57.658658279" Jun 08 13:44:47.355347 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:47.355307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:47.359921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:47.359894 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mdg2q" Jun 08 13:44:48.290776 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.290741 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q"] Jun 08 13:44:48.293843 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.293827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.300286 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.300263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 13:44:48.300402 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.300304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:44:48.300402 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.300373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6k6ns\"" Jun 08 13:44:48.300737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.300723 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:44:48.301230 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.301213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 13:44:48.301271 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.301221 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:44:48.322702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.322682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q"] Jun 08 13:44:48.384796 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.384767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.385130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.384800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.385130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.384825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f6fd8-97ad-4343-a344-69b60f72fd68-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.385130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.384908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgllc\" (UniqueName: \"kubernetes.io/projected/fb6f6fd8-97ad-4343-a344-69b60f72fd68-kube-api-access-pgllc\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.485913 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.485877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.485913 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.485914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.486098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.486055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f6fd8-97ad-4343-a344-69b60f72fd68-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.486146 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.486130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgllc\" (UniqueName: \"kubernetes.io/projected/fb6f6fd8-97ad-4343-a344-69b60f72fd68-kube-api-access-pgllc\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.486805 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.486781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f6fd8-97ad-4343-a344-69b60f72fd68-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.489395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.489374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.489480 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.489399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb6f6fd8-97ad-4343-a344-69b60f72fd68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.495578 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.495557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgllc\" (UniqueName: \"kubernetes.io/projected/fb6f6fd8-97ad-4343-a344-69b60f72fd68-kube-api-access-pgllc\") pod \"prometheus-operator-7f7d445d84-n2k8q\" (UID: \"fb6f6fd8-97ad-4343-a344-69b60f72fd68\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.602886 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.602812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" Jun 08 13:44:48.726395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:48.726367 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q"] Jun 08 13:44:48.729091 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:48.729068 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6f6fd8_97ad_4343_a344_69b60f72fd68.slice/crio-839138ef24d0698ae1f4772b7f3c01912bf462b55fec4b6f893cdf5b37eee5d0 WatchSource:0}: Error finding container 839138ef24d0698ae1f4772b7f3c01912bf462b55fec4b6f893cdf5b37eee5d0: Status 404 returned error can't find the container with id 839138ef24d0698ae1f4772b7f3c01912bf462b55fec4b6f893cdf5b37eee5d0 Jun 08 13:44:49.364332 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:49.364291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" event={"ID":"fb6f6fd8-97ad-4343-a344-69b60f72fd68","Type":"ContainerStarted","Data":"839138ef24d0698ae1f4772b7f3c01912bf462b55fec4b6f893cdf5b37eee5d0"} Jun 08 13:44:50.274445 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:50.274420 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htmnw" Jun 08 13:44:51.372565 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:51.372516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" event={"ID":"fb6f6fd8-97ad-4343-a344-69b60f72fd68","Type":"ContainerStarted","Data":"2a7ddb4fcc62ed6c87b3d7c40b05080abbfff4f967a26cf84479782edf3ec3d8"} Jun 08 13:44:51.372565 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:51.372571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" event={"ID":"fb6f6fd8-97ad-4343-a344-69b60f72fd68","Type":"ContainerStarted","Data":"43b78848f392084c193f69d023a8805a7da411599daf77f2d664efe5420e9c5f"} Jun 08 13:44:51.390211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:51.390166 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-n2k8q" podStartSLOduration=1.780017753 podStartE2EDuration="3.390152374s" totalImagesPullingTime="1.610134621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:51.389377106 +0000 UTC m=+62.679894014" watchObservedRunningTime="2026-06-08 13:44:51.390152374 +0000 UTC m=+62.680669249" Jun 08 13:44:53.640064 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.640029 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j"] Jun 08 13:44:53.643165 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.643147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.646613 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.646592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5qwtd\"" Jun 08 13:44:53.646613 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.646614 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 13:44:53.646801 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.646593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 13:44:53.651341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.651319 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr"] Jun 08 13:44:53.653669 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.653652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.656510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.656492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 13:44:53.656510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.656501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 13:44:53.657468 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.657451 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 13:44:53.658142 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.658126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8z42f\"" Jun 08 13:44:53.659135 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.659118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j"] Jun 08 13:44:53.670807 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.670781 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr"] Jun 08 13:44:53.694345 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.694322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v45nk"] Jun 08 13:44:53.696802 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.696785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.699598 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.699574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:44:53.699700 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.699597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:44:53.699700 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.699616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:44:53.699700 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.699616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cpglf\"" Jun 08 13:44:53.721169 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.721291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2pr\" (UniqueName: \"kubernetes.io/projected/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-api-access-2m2pr\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721452 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/616d75ac-2d58-46c3-8926-421dfc2c9d23-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721452 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721452 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ee2cd-adfb-41fa-b086-3dd418727ded-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.721541 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.721541 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.721541 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.721510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfv5p\" (UniqueName: \"kubernetes.io/projected/2c3ee2cd-adfb-41fa-b086-3dd418727ded-kube-api-access-jfv5p\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.822367 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-sys\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.822483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ee2cd-adfb-41fa-b086-3dd418727ded-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.822483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfv5p\" (UniqueName: \"kubernetes.io/projected/2c3ee2cd-adfb-41fa-b086-3dd418727ded-kube-api-access-jfv5p\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.822483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.822483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-wtmp\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.822620 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.822679 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-tls\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.822741 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.822821 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.822780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.823559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-accelerators-collector-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.823720 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ee2cd-adfb-41fa-b086-3dd418727ded-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.823808 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-metrics-client-ca\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.823865 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wbn\" (UniqueName: \"kubernetes.io/projected/9adec353-80fb-423f-a40c-d6f9da14dd53-kube-api-access-d4wbn\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.823920 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/616d75ac-2d58-46c3-8926-421dfc2c9d23-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.823970 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.824043 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.824095 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.824040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-root\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.824095 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.824076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2pr\" (UniqueName: \"kubernetes.io/projected/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-api-access-2m2pr\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.824199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.824113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.824199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.824149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-textfile\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.824284 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823720 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.824360 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.823724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616d75ac-2d58-46c3-8926-421dfc2c9d23-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.824574 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.824550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/616d75ac-2d58-46c3-8926-421dfc2c9d23-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.826499 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.826438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.828206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.827427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.828206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.827702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c3ee2cd-adfb-41fa-b086-3dd418727ded-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.829837 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.829816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.831211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.831194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfv5p\" (UniqueName: \"kubernetes.io/projected/2c3ee2cd-adfb-41fa-b086-3dd418727ded-kube-api-access-jfv5p\") pod \"openshift-state-metrics-65f78d5c66-tb24j\" (UID: \"2c3ee2cd-adfb-41fa-b086-3dd418727ded\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.834697 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.834677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2pr\" (UniqueName: \"kubernetes.io/projected/616d75ac-2d58-46c3-8926-421dfc2c9d23-kube-api-access-2m2pr\") pod \"kube-state-metrics-57bbf8bfb5-d22wr\" (UID: \"616d75ac-2d58-46c3-8926-421dfc2c9d23\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:53.924921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.924894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-metrics-client-ca\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.924925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wbn\" (UniqueName: \"kubernetes.io/projected/9adec353-80fb-423f-a40c-d6f9da14dd53-kube-api-access-d4wbn\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.924966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-root\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-textfile\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-sys\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-wtmp\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-tls\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-root\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-sys\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-accelerators-collector-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-wtmp\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925447 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-textfile\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925701 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-metrics-client-ca\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.925701 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.925620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-accelerators-collector-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.927351 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.927332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.927521 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.927504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9adec353-80fb-423f-a40c-d6f9da14dd53-node-exporter-tls\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.940886 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.940864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wbn\" (UniqueName: \"kubernetes.io/projected/9adec353-80fb-423f-a40c-d6f9da14dd53-kube-api-access-d4wbn\") pod \"node-exporter-v45nk\" (UID: \"9adec353-80fb-423f-a40c-d6f9da14dd53\") " pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:53.951844 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.951826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" Jun 08 13:44:53.962209 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:53.962193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" Jun 08 13:44:54.006097 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.005735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v45nk" Jun 08 13:44:54.021685 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:54.021649 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adec353_80fb_423f_a40c_d6f9da14dd53.slice/crio-45b10af181b74b7ac414a071ee029ceda19a87a2ffce7166d5f99016a13ec3da WatchSource:0}: Error finding container 45b10af181b74b7ac414a071ee029ceda19a87a2ffce7166d5f99016a13ec3da: Status 404 returned error can't find the container with id 45b10af181b74b7ac414a071ee029ceda19a87a2ffce7166d5f99016a13ec3da Jun 08 13:44:54.095642 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.095623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j"] Jun 08 13:44:54.098264 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:54.098227 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3ee2cd_adfb_41fa_b086_3dd418727ded.slice/crio-000cd2b7858b14c9196c734d0812aaf9083bd28e07b6a9e98a8a31675b7c67b4 WatchSource:0}: Error finding container 000cd2b7858b14c9196c734d0812aaf9083bd28e07b6a9e98a8a31675b7c67b4: Status 404 returned error can't find the container with id 000cd2b7858b14c9196c734d0812aaf9083bd28e07b6a9e98a8a31675b7c67b4 Jun 08 13:44:54.109831 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.109807 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr"] Jun 08 13:44:54.112911 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:54.112882 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616d75ac_2d58_46c3_8926_421dfc2c9d23.slice/crio-458acd919628ea0baae95364b6523eba2976b12eb0765dd7c7ce1430e55c4eac WatchSource:0}: Error finding container 458acd919628ea0baae95364b6523eba2976b12eb0765dd7c7ce1430e55c4eac: Status 404 returned error can't find the container with id 458acd919628ea0baae95364b6523eba2976b12eb0765dd7c7ce1430e55c4eac Jun 08 13:44:54.382456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.382420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v45nk" event={"ID":"9adec353-80fb-423f-a40c-d6f9da14dd53","Type":"ContainerStarted","Data":"45b10af181b74b7ac414a071ee029ceda19a87a2ffce7166d5f99016a13ec3da"} Jun 08 13:44:54.383519 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.383493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" event={"ID":"616d75ac-2d58-46c3-8926-421dfc2c9d23","Type":"ContainerStarted","Data":"458acd919628ea0baae95364b6523eba2976b12eb0765dd7c7ce1430e55c4eac"} Jun 08 13:44:54.385312 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.385291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" event={"ID":"2c3ee2cd-adfb-41fa-b086-3dd418727ded","Type":"ContainerStarted","Data":"fe323ced40ddd1b1196cf033ba553a290be39fd5b37709b76bfd07ecd7d8ce3f"} Jun 08 13:44:54.385396 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.385337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" event={"ID":"2c3ee2cd-adfb-41fa-b086-3dd418727ded","Type":"ContainerStarted","Data":"fc356d6a4a59e421d95e76461b31a0b2d20fb48c17ae3723074a47132af8ae99"} Jun 08 13:44:54.385396 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.385357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" event={"ID":"2c3ee2cd-adfb-41fa-b086-3dd418727ded","Type":"ContainerStarted","Data":"000cd2b7858b14c9196c734d0812aaf9083bd28e07b6a9e98a8a31675b7c67b4"} Jun 08 13:44:54.802029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.800870 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:44:54.805123 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.805099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.808094 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.807870 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 13:44:54.808094 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.807928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 13:44:54.808291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.808221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 13:44:54.808291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.808240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 13:44:54.808700 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.808681 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m5rxs\"" Jun 08 13:44:54.808917 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.808898 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 13:44:54.809029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.808919 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 13:44:54.809196 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.809181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 13:44:54.809291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.809227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 13:44:54.809291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.809184 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 13:44:54.820824 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.820787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:44:54.833843 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.833813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:54.833982 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.833877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:54.836849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.836778 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:44:54.836849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.836790 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:44:54.848514 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.848485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a626f4c8-42a1-469d-9153-c9fb92be64eb-metrics-certs\") pod \"network-metrics-daemon-qgk8v\" (UID: \"a626f4c8-42a1-469d-9153-c9fb92be64eb\") " pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:54.849337 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.849315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03abd6b8-4546-4b13-9e40-fe59b2cf3b2d-original-pull-secret\") pod \"global-pull-secret-syncer-x988q\" (UID: \"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d\") " pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:54.912142 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.912094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x988q" Jun 08 13:44:54.934378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9khd\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.934868 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.934806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:54.937931 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.937896 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:44:54.948131 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.948097 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:44:54.958910 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:54.958870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9msg\" (UniqueName: \"kubernetes.io/projected/1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2-kube-api-access-h9msg\") pod \"network-check-target-hknq8\" (UID: \"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2\") " pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:55.008880 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.008818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96pfm\"" Jun 08 13:44:55.014803 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.014767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-229wc\"" Jun 08 13:44:55.016858 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.016826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qgk8v" Jun 08 13:44:55.023200 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.023159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:44:55.035662 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.035838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.035838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.035838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.035838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.035838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.035975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9khd\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.036046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.036159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.036087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.037473 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.037446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.039937 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.039120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.040765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.040259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.040765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.040409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.042524 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.042465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.043109 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.043082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.044080 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.044027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.045865 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.045834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.046570 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.046524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.046899 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.046855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.047639 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.047616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.047825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.047808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9khd\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.050010 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.049947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.122231 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.122156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:44:55.354347 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.354312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bz69m" Jun 08 13:44:55.661544 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.659529 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-774995c7bb-g7xw9"] Jun 08 13:44:55.665453 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.665426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.668293 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668259 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 13:44:55.668440 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2fsh7\"" Jun 08 13:44:55.668440 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668430 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 13:44:55.668566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 13:44:55.668566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c2lnjuvmbuik4\"" Jun 08 13:44:55.668566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 13:44:55.668762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.668743 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 13:44:55.676068 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.676037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774995c7bb-g7xw9"] Jun 08 13:44:55.741125 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtmtl\" (UniqueName: \"kubernetes.io/projected/fc419787-1b89-40a2-b91f-52d43c844f7a-kube-api-access-xtmtl\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741233 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741398 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741398 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc419787-1b89-40a2-b91f-52d43c844f7a-metrics-client-ca\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741398 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.741530 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.741418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-grpc-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844356 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc419787-1b89-40a2-b91f-52d43c844f7a-metrics-client-ca\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-grpc-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtmtl\" (UniqueName: \"kubernetes.io/projected/fc419787-1b89-40a2-b91f-52d43c844f7a-kube-api-access-xtmtl\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.844822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.844575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.848333 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.847739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc419787-1b89-40a2-b91f-52d43c844f7a-metrics-client-ca\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.865319 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.865251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.866540 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.866457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtmtl\" (UniqueName: \"kubernetes.io/projected/fc419787-1b89-40a2-b91f-52d43c844f7a-kube-api-access-xtmtl\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.868311 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.867300 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-grpc-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.868311 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.867772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.868311 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.868260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.869220 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.869193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-tls\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.877977 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.877775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc419787-1b89-40a2-b91f-52d43c844f7a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c7bb-g7xw9\" (UID: \"fc419787-1b89-40a2-b91f-52d43c844f7a\") " pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:55.965930 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.965872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x988q"] Jun 08 13:44:55.974193 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:55.971849 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03abd6b8_4546_4b13_9e40_fe59b2cf3b2d.slice/crio-061e1d64f51a658677bb57fea131f73b091877158828b4deede3ad0b9c12ebae WatchSource:0}: Error finding container 061e1d64f51a658677bb57fea131f73b091877158828b4deede3ad0b9c12ebae: Status 404 returned error can't find the container with id 061e1d64f51a658677bb57fea131f73b091877158828b4deede3ad0b9c12ebae Jun 08 13:44:55.977192 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:55.976756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:44:56.168923 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.168830 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774995c7bb-g7xw9"] Jun 08 13:44:56.173750 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:56.172817 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc419787_1b89_40a2_b91f_52d43c844f7a.slice/crio-2fb2cb2ceab8c52a21f0fd87ef6aa1e8ea315e0aa5a523ccee3a4a51860a3786 WatchSource:0}: Error finding container 2fb2cb2ceab8c52a21f0fd87ef6aa1e8ea315e0aa5a523ccee3a4a51860a3786: Status 404 returned error can't find the container with id 2fb2cb2ceab8c52a21f0fd87ef6aa1e8ea315e0aa5a523ccee3a4a51860a3786 Jun 08 13:44:56.217251 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.217174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hknq8"] Jun 08 13:44:56.219840 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:56.219796 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbb6b4c_e505_49a4_b71d_fdba3dd60cc2.slice/crio-fcea7ab3b54d5ee96612bff5d460a406dd35f94a74697f0610ba93f8e7c3616f WatchSource:0}: Error finding container fcea7ab3b54d5ee96612bff5d460a406dd35f94a74697f0610ba93f8e7c3616f: Status 404 returned error can't find the container with id fcea7ab3b54d5ee96612bff5d460a406dd35f94a74697f0610ba93f8e7c3616f Jun 08 13:44:56.220533 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.220507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qgk8v"] Jun 08 13:44:56.223182 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:56.223142 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda626f4c8_42a1_469d_9153_c9fb92be64eb.slice/crio-318d65bdf23183a6a2bef95480950372d2d4eb0ee33b4e2e327ed18a00a0f3e8 WatchSource:0}: Error finding container 318d65bdf23183a6a2bef95480950372d2d4eb0ee33b4e2e327ed18a00a0f3e8: Status 404 returned error can't find the container with id 318d65bdf23183a6a2bef95480950372d2d4eb0ee33b4e2e327ed18a00a0f3e8 Jun 08 13:44:56.252239 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.252205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:44:56.255526 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:44:56.255495 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00377a2a_f108_4134_8d83_dc21e436a5e0.slice/crio-49d66cfb456eb3b7b01c81f2a8a6b532019ecf9ad0911588f9819efc2df582cc WatchSource:0}: Error finding container 49d66cfb456eb3b7b01c81f2a8a6b532019ecf9ad0911588f9819efc2df582cc: Status 404 returned error can't find the container with id 49d66cfb456eb3b7b01c81f2a8a6b532019ecf9ad0911588f9819efc2df582cc Jun 08 13:44:56.397649 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.397611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" event={"ID":"2c3ee2cd-adfb-41fa-b086-3dd418727ded","Type":"ContainerStarted","Data":"d2d499a2afa364e7831af886f1cca429520fd9998bb36f19658cb91db02f8d55"} Jun 08 13:44:56.399589 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.399558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"49d66cfb456eb3b7b01c81f2a8a6b532019ecf9ad0911588f9819efc2df582cc"} Jun 08 13:44:56.404459 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.404423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qgk8v" event={"ID":"a626f4c8-42a1-469d-9153-c9fb92be64eb","Type":"ContainerStarted","Data":"318d65bdf23183a6a2bef95480950372d2d4eb0ee33b4e2e327ed18a00a0f3e8"} Jun 08 13:44:56.405941 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.405911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hknq8" event={"ID":"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2","Type":"ContainerStarted","Data":"fcea7ab3b54d5ee96612bff5d460a406dd35f94a74697f0610ba93f8e7c3616f"} Jun 08 13:44:56.407531 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.407495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"2fb2cb2ceab8c52a21f0fd87ef6aa1e8ea315e0aa5a523ccee3a4a51860a3786"} Jun 08 13:44:56.409245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.409218 2576 generic.go:356] "Generic (PLEG): container finished" podID="9adec353-80fb-423f-a40c-d6f9da14dd53" containerID="3d0d194311996e6155fe1f6a67e7d998aaf23faf58f2d8cf08f6df28f9c343da" exitCode=0 Jun 08 13:44:56.409358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.409292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v45nk" event={"ID":"9adec353-80fb-423f-a40c-d6f9da14dd53","Type":"ContainerDied","Data":"3d0d194311996e6155fe1f6a67e7d998aaf23faf58f2d8cf08f6df28f9c343da"} Jun 08 13:44:56.411898 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.411869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" event={"ID":"616d75ac-2d58-46c3-8926-421dfc2c9d23","Type":"ContainerStarted","Data":"84c1e90c0f26fa18c8c0e792bce283a4922a68ca52fb734bdf0610d30f8c45c2"} Jun 08 13:44:56.412098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.411925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" event={"ID":"616d75ac-2d58-46c3-8926-421dfc2c9d23","Type":"ContainerStarted","Data":"bf5618c28f2bcee403a83dbeee6ced8a567a3839c55896468be5d801d44be917"} Jun 08 13:44:56.412098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.411957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" event={"ID":"616d75ac-2d58-46c3-8926-421dfc2c9d23","Type":"ContainerStarted","Data":"8fee6ec122fc777240640bfa145c9fe96931ec945d1598773d15b30085261808"} Jun 08 13:44:56.413528 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.413505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x988q" event={"ID":"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d","Type":"ContainerStarted","Data":"061e1d64f51a658677bb57fea131f73b091877158828b4deede3ad0b9c12ebae"} Jun 08 13:44:56.422826 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.422763 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tb24j" podStartSLOduration=1.863269338 podStartE2EDuration="3.422742364s" totalImagesPullingTime="1.559473026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:56.422326458 +0000 UTC m=+67.712843356" watchObservedRunningTime="2026-06-08 13:44:56.422742364 +0000 UTC m=+67.713259261" Jun 08 13:44:56.468977 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:56.468905 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d22wr" podStartSLOduration=1.803170786 podStartE2EDuration="3.468883867s" totalImagesPullingTime="1.665713081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:56.468331929 +0000 UTC m=+67.758848826" watchObservedRunningTime="2026-06-08 13:44:56.468883867 +0000 UTC m=+67.759400765" Jun 08 13:44:57.424154 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:57.424027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v45nk" event={"ID":"9adec353-80fb-423f-a40c-d6f9da14dd53","Type":"ContainerStarted","Data":"494122b16c77c740618494e3ddb54ad15eec8b890ab1aac475e6803c83fd7b56"} Jun 08 13:44:57.424154 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:57.424097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v45nk" event={"ID":"9adec353-80fb-423f-a40c-d6f9da14dd53","Type":"ContainerStarted","Data":"6f53750231e3bf691b85befe6c7197c19fc6ee42d79c2a5cb005bdc8d3f38bc1"} Jun 08 13:44:58.101436 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.101369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v45nk" podStartSLOduration=3.232047104 podStartE2EDuration="5.10134689s" totalImagesPullingTime="1.747296188s" totalInitContainerRuntime="122.003598ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:57.458397749 +0000 UTC m=+68.748914659" watchObservedRunningTime="2026-06-08 13:44:58.10134689 +0000 UTC m=+69.391863786" Jun 08 13:44:58.102340 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.102314 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c6b8dd46c-v956f"] Jun 08 13:44:58.116474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.116060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.121298 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.120930 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 13:44:58.122942 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.122620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 13:44:58.122942 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.122622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4gajv7h7fjd0p\"" Jun 08 13:44:58.123293 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.123264 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6b8dd46c-v956f"] Jun 08 13:44:58.123423 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.123388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b2vj6\"" Jun 08 13:44:58.123494 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.123420 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 13:44:58.123609 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.123593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 13:44:58.268037 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.267927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268037 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.267982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-client-certs\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268296 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.268118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-audit-log\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268296 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.268157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-metrics-server-audit-profiles\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268296 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.268188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-tls\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268296 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.268218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-client-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.268296 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.268237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9bht\" (UniqueName: \"kubernetes.io/projected/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-kube-api-access-t9bht\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.368879 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.368783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-audit-log\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.368879 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.368839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-metrics-server-audit-profiles\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.368879 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.368878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-tls\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.369157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.368912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-client-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.369157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.368940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bht\" (UniqueName: \"kubernetes.io/projected/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-kube-api-access-t9bht\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.369157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.369015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.369157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.369044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-client-certs\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.370206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.370143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-audit-log\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.370806 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.370772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-metrics-server-audit-profiles\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.370926 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.370849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.373123 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.373097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-client-ca-bundle\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.374022 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.373977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-tls\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.374281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.374242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-secret-metrics-server-client-certs\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.386848 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.386780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9bht\" (UniqueName: \"kubernetes.io/projected/f7f7a444-b7f0-4c6b-8697-de1b96a8fb27-kube-api-access-t9bht\") pod \"metrics-server-6c6b8dd46c-v956f\" (UID: \"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27\") " pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.437030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.436769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:44:58.502705 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.502671 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk"] Jun 08 13:44:58.505685 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.505226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.509371 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.508943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wsccf\"" Jun 08 13:44:58.509371 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.509191 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 13:44:58.515939 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.515910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk"] Jun 08 13:44:58.571150 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.571095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnj5q\" (UniqueName: \"kubernetes.io/projected/0761857b-0e0d-4d47-aa3d-554937825874-kube-api-access-mnj5q\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.571346 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.571189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.672463 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.672414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnj5q\" (UniqueName: \"kubernetes.io/projected/0761857b-0e0d-4d47-aa3d-554937825874-kube-api-access-mnj5q\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.672463 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.672469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.672703 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:58.672621 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 13:44:58.672703 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:44:58.672702 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert podName:0761857b-0e0d-4d47-aa3d-554937825874 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:59.172679242 +0000 UTC m=+70.463196122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-lzmqk" (UID: "0761857b-0e0d-4d47-aa3d-554937825874") : secret "monitoring-plugin-cert" not found Jun 08 13:44:58.688665 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.688629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnj5q\" (UniqueName: \"kubernetes.io/projected/0761857b-0e0d-4d47-aa3d-554937825874-kube-api-access-mnj5q\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:58.926722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.926483 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7fbf667699-jdbws"] Jun 08 13:44:58.929238 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.929203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:58.932693 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.932667 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 13:44:58.932956 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.932934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 13:44:58.933466 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.933444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 13:44:58.933564 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.933487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 13:44:58.934824 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.934799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 13:44:58.935045 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.935020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d7dtn\"" Jun 08 13:44:58.940082 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.939817 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 13:44:58.950938 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:58.950906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fbf667699-jdbws"] Jun 08 13:44:59.076226 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqp6\" (UniqueName: \"kubernetes.io/projected/9461b0a2-9ab0-4999-95da-2b8aef5863b0-kube-api-access-drqp6\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-serving-certs-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-metrics-client-ca\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.076616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.076517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-federate-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.177978 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.177868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-federate-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.177978 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.177964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqp6\" (UniqueName: \"kubernetes.io/projected/9461b0a2-9ab0-4999-95da-2b8aef5863b0-kube-api-access-drqp6\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-serving-certs-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.178266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.178249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-metrics-client-ca\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.179080 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.179053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-metrics-client-ca\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.181087 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.180972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-serving-certs-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.182524 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.181660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.183370 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.183340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-federate-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.184012 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.183961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-telemeter-client-tls\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.184111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.184096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0761857b-0e0d-4d47-aa3d-554937825874-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lzmqk\" (UID: \"0761857b-0e0d-4d47-aa3d-554937825874\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:44:59.185443 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.185417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.185618 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.185595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9461b0a2-9ab0-4999-95da-2b8aef5863b0-secret-telemeter-client\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.198384 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.198336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqp6\" (UniqueName: \"kubernetes.io/projected/9461b0a2-9ab0-4999-95da-2b8aef5863b0-kube-api-access-drqp6\") pod \"telemeter-client-7fbf667699-jdbws\" (UID: \"9461b0a2-9ab0-4999-95da-2b8aef5863b0\") " pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.242834 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.242798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" Jun 08 13:44:59.428629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:44:59.428538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:45:00.076772 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.075111 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:45:00.081459 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.081421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.093360 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093333 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 13:45:00.093726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8d999\"" Jun 08 13:45:00.093856 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 13:45:00.093944 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093926 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 13:45:00.094086 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094066 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 13:45:00.094150 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 13:45:00.094257 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 13:45:00.094427 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094405 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 13:45:00.094517 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 13:45:00.094557 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 13:45:00.094592 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.093938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 13:45:00.094629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094612 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 13:45:00.094629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9gk6alttkf70c\"" Jun 08 13:45:00.094949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.094931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 13:45:00.096389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.096346 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 13:45:00.099848 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.099829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 13:45:00.126333 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.126301 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:45:00.189267 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59fh\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189698 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.189878 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.190167 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.189892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59fh\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.290978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.291214 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.292254 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.292254 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.292254 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.291698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.292949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.292919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.294244 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.294218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.294897 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.294556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.297310 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.297287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.297509 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.297481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.298467 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.298447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.302596 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.302095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.306013 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.303358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.306013 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.303467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.306341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.306314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.306794 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.306769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.307768 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.307725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.308616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.308555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.309358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.309303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.309828 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.309804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.310347 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.310324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.310434 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.310413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.312190 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.312165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.312397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.312352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59fh\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.312397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.312341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:00.397457 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:00.397423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:01.875358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:01.874949 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk"] Jun 08 13:45:01.916406 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:01.915788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fbf667699-jdbws"] Jun 08 13:45:01.944241 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:01.943882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6b8dd46c-v956f"] Jun 08 13:45:01.948206 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:45:01.948159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f7a444_b7f0_4c6b_8697_de1b96a8fb27.slice/crio-c97fc93e08098e6bdc02dca0a26368394cb1490a81d66a55f4665d90d7697ab1 WatchSource:0}: Error finding container c97fc93e08098e6bdc02dca0a26368394cb1490a81d66a55f4665d90d7697ab1: Status 404 returned error can't find the container with id c97fc93e08098e6bdc02dca0a26368394cb1490a81d66a55f4665d90d7697ab1 Jun 08 13:45:01.955961 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:01.955643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:45:02.447877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.447838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x988q" event={"ID":"03abd6b8-4546-4b13-9e40-fe59b2cf3b2d","Type":"ContainerStarted","Data":"8b1f0f6068b47f0468930df829f6fd1905588b18c8adb39d4a2d602c3a5f8e29"} Jun 08 13:45:02.449051 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.449022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" event={"ID":"9461b0a2-9ab0-4999-95da-2b8aef5863b0","Type":"ContainerStarted","Data":"24b114205cca3a47b8549f5e93bed68b20633253ef6e55d81c060b9039bd1676"} Jun 08 13:45:02.450507 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.450480 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5" exitCode=0 Jun 08 13:45:02.450610 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.450549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5"} Jun 08 13:45:02.452504 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.452480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qgk8v" event={"ID":"a626f4c8-42a1-469d-9153-c9fb92be64eb","Type":"ContainerStarted","Data":"8528bc2d953a6ca35b2fda1e1a2aded993aff110226349e077d36e752d73fe5e"} Jun 08 13:45:02.452611 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.452526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qgk8v" event={"ID":"a626f4c8-42a1-469d-9153-c9fb92be64eb","Type":"ContainerStarted","Data":"841b713cd901da84328c343c97e420f358ee29cd77fd0b5a176dc4669ccc5b38"} Jun 08 13:45:02.453877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.453855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" event={"ID":"0761857b-0e0d-4d47-aa3d-554937825874","Type":"ContainerStarted","Data":"694e6194f47e6e2cb479b1d15889df745b748f9441d500a02ea1201ff330fa6e"} Jun 08 13:45:02.455675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.455650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hknq8" event={"ID":"1bbb6b4c-e505-49a4-b71d-fdba3dd60cc2","Type":"ContainerStarted","Data":"98167eed5462c13c0604b70b803384caf30896b704f960ca77faa20a747bf8a8"} Jun 08 13:45:02.455849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.455820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:45:02.457159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.457135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" event={"ID":"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27","Type":"ContainerStarted","Data":"c97fc93e08098e6bdc02dca0a26368394cb1490a81d66a55f4665d90d7697ab1"} Jun 08 13:45:02.459736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.459712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"0f9d09bbd324a8c021fa0d2596f7630437fedc3d4c85cda22d218402eff79192"} Jun 08 13:45:02.459813 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.459774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"0c36fe0425048f22c979209f3d3def511518f5b11d939365e87199ef4db71f34"} Jun 08 13:45:02.459871 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.459814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"92c157cc991b30897e5fc7065795f77d381acd911256c7f46c2b434f735fb5ca"} Jun 08 13:45:02.461389 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.461362 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" exitCode=0 Jun 08 13:45:02.461464 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.461397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} Jun 08 13:45:02.461464 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.461449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"005a2b74786e27d09741182ec942b787d25ade90060759ce813d3ee3843e45ef"} Jun 08 13:45:02.465506 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.465460 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x988q" podStartSLOduration=67.800320305 podStartE2EDuration="1m13.465445646s" totalImagesPullingTime="5.665125341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:02.465291755 +0000 UTC m=+73.755808653" watchObservedRunningTime="2026-06-08 13:45:02.465445646 +0000 UTC m=+73.755962545" Jun 08 13:45:02.514256 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.513136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hknq8" podStartSLOduration=68.111175484 podStartE2EDuration="1m13.513082555s" totalImagesPullingTime="5.401907071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:02.512246475 +0000 UTC m=+73.802763372" watchObservedRunningTime="2026-06-08 13:45:02.513082555 +0000 UTC m=+73.803599453" Jun 08 13:45:02.564057 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:02.563971 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qgk8v" podStartSLOduration=69.694768219 podStartE2EDuration="1m13.56395196s" totalImagesPullingTime="3.869183741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:02.562712614 +0000 UTC m=+73.853229512" watchObservedRunningTime="2026-06-08 13:45:02.56395196 +0000 UTC m=+73.854468857" Jun 08 13:45:06.501136 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.500962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" event={"ID":"f7f7a444-b7f0-4c6b-8697-de1b96a8fb27","Type":"ContainerStarted","Data":"bb039e7d59b4ebf469f7574a22b28ef90b7d342ceddb063ff9727af340e597bc"} Jun 08 13:45:06.507294 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.507255 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"bbbc8c1f0111ca232a9aac30ee596dacbaa5d617cde6e602b013946d59e71fa8"} Jun 08 13:45:06.507419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.507339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"d11ca58ee77c78709e1028a236948e4ed5694441eb8a376605d502c9fd1dc90f"} Jun 08 13:45:06.507419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.507386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" event={"ID":"fc419787-1b89-40a2-b91f-52d43c844f7a","Type":"ContainerStarted","Data":"8cc74c8bb626d0caf30749e6bcc2f5bafe53247f4dd9f47267b4b8513ff8e1e0"} Jun 08 13:45:06.507534 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.507430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:45:06.513025 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.512665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} Jun 08 13:45:06.513025 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.512752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} Jun 08 13:45:06.517266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.516819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" Jun 08 13:45:06.519598 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.519565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" event={"ID":"9461b0a2-9ab0-4999-95da-2b8aef5863b0","Type":"ContainerStarted","Data":"e887fd44fa42010a73f4544b6cf1661b226b2667bff53c70a3a0721401e38665"} Jun 08 13:45:06.519750 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.519634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" event={"ID":"9461b0a2-9ab0-4999-95da-2b8aef5863b0","Type":"ContainerStarted","Data":"1f70eb94d8d193503bcf6cd9df8d982a55d43c1c9c6de29a1dd6b98d8c47f2a8"} Jun 08 13:45:06.533155 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.532232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" podStartSLOduration=4.384175589 podStartE2EDuration="8.532208033s" totalImagesPullingTime="4.148032444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:06.526944285 +0000 UTC m=+77.817461180" watchObservedRunningTime="2026-06-08 13:45:06.532208033 +0000 UTC m=+77.822724928" Jun 08 13:45:06.533753 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.533602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f"} Jun 08 13:45:06.533753 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.533682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40"} Jun 08 13:45:06.539130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.539046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" event={"ID":"0761857b-0e0d-4d47-aa3d-554937825874","Type":"ContainerStarted","Data":"040f6ec8290a86c8992d1fa0afade6ed1070bc2b87ea99a67f9fc85a80517685"} Jun 08 13:45:06.542647 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.540842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:45:06.556967 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.556753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" Jun 08 13:45:06.563824 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:06.563764 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-774995c7bb-g7xw9" podStartSLOduration=2.060419973 podStartE2EDuration="11.563740697s" totalImagesPullingTime="9.503320724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:06.561455548 +0000 UTC m=+77.851972446" watchObservedRunningTime="2026-06-08 13:45:06.563740697 +0000 UTC m=+77.854257598" Jun 08 13:45:07.548251 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.548209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907"} Jun 08 13:45:07.548735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.548330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5"} Jun 08 13:45:07.548735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.548372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89"} Jun 08 13:45:07.548735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.548398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerStarted","Data":"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293"} Jun 08 13:45:07.552205 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.552171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} Jun 08 13:45:07.552373 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.552240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} Jun 08 13:45:07.552373 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.552286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} Jun 08 13:45:07.552373 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.552322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerStarted","Data":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} Jun 08 13:45:07.554638 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.554601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" event={"ID":"9461b0a2-9ab0-4999-95da-2b8aef5863b0","Type":"ContainerStarted","Data":"3574427d8e04c9b79ef3da5d6890f3d2fe27cc357b1004ff9e14aefbc4b25dc8"} Jun 08 13:45:07.578507 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.578440 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.5751615789999995 podStartE2EDuration="13.578418854s" totalImagesPullingTime="8.976334498s" totalInitContainerRuntime="26.922777ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:07.576704637 +0000 UTC m=+78.867221545" watchObservedRunningTime="2026-06-08 13:45:07.578418854 +0000 UTC m=+78.868935748" Jun 08 13:45:07.578806 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.578775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lzmqk" podStartSLOduration=5.399633225 podStartE2EDuration="9.578766139s" totalImagesPullingTime="4.179132914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:06.587444331 +0000 UTC m=+77.877961229" watchObservedRunningTime="2026-06-08 13:45:07.578766139 +0000 UTC m=+78.869283069" Jun 08 13:45:07.604059 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.603977 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7fbf667699-jdbws" podStartSLOduration=5.419598792 podStartE2EDuration="9.603959568s" totalImagesPullingTime="4.184360776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:07.602932349 +0000 UTC m=+78.893449248" watchObservedRunningTime="2026-06-08 13:45:07.603959568 +0000 UTC m=+78.894476458" Jun 08 13:45:07.636182 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:07.636119 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.9208771159999998 podStartE2EDuration="7.636100247s" totalImagesPullingTime="3.694331996s" totalInitContainerRuntime="20.891135ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:07.634416472 +0000 UTC m=+78.924933394" watchObservedRunningTime="2026-06-08 13:45:07.636100247 +0000 UTC m=+78.926617127" Jun 08 13:45:10.398877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:10.398833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:45:18.438104 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:18.438049 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:45:18.438576 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:18.438143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:45:33.472204 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:33.472172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hknq8" Jun 08 13:45:38.442592 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:38.442556 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:45:38.446534 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:45:38.446504 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c6b8dd46c-v956f" Jun 08 13:46:00.398529 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:00.398482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:00.418836 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:00.418808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:00.782142 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:00.782057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:14.117627 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.117596 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:14.118090 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.117915 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="alertmanager" containerID="cri-o://bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40" gracePeriod=120 Jun 08 13:46:14.118090 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.117942 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-metric" containerID="cri-o://df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5" gracePeriod=120 Jun 08 13:46:14.118090 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.118017 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-web" containerID="cri-o://e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293" gracePeriod=120 Jun 08 13:46:14.118304 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.118054 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="config-reloader" containerID="cri-o://1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f" gracePeriod=120 Jun 08 13:46:14.118304 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.118025 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy" containerID="cri-o://00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89" gracePeriod=120 Jun 08 13:46:14.118304 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.118020 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="prom-label-proxy" containerID="cri-o://72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907" gracePeriod=120 Jun 08 13:46:14.830102 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830065 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907" exitCode=0 Jun 08 13:46:14.830102 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830095 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5" exitCode=0 Jun 08 13:46:14.830102 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830103 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89" exitCode=0 Jun 08 13:46:14.830102 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830108 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f" exitCode=0 Jun 08 13:46:14.830102 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830113 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40" exitCode=0 Jun 08 13:46:14.830387 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907"} Jun 08 13:46:14.830387 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5"} Jun 08 13:46:14.830387 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89"} Jun 08 13:46:14.830387 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f"} Jun 08 13:46:14.830387 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:14.830285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40"} Jun 08 13:46:15.364379 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.364354 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.483640 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483640 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483588 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483640 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9khd\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483688 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483716 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483761 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483786 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483814 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483836 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.483900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483874 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.484407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483908 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.484407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.483931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db\") pod \"00377a2a-f108-4134-8d83-dc21e436a5e0\" (UID: \"00377a2a-f108-4134-8d83-dc21e436a5e0\") " Jun 08 13:46:15.484407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.484124 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:15.484407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.484388 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.484407 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.484397 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:46:15.485409 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.485381 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:15.487410 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.487376 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.487535 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.487506 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd" (OuterVolumeSpecName: "kube-api-access-m9khd") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "kube-api-access-m9khd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:46:15.487660 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.487626 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out" (OuterVolumeSpecName: "config-out") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:46:15.487874 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.487831 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume" (OuterVolumeSpecName: "config-volume") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.487874 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.487845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:46:15.488229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.488196 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.488438 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.488419 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.488767 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.488738 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.492142 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.491949 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.498938 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.498912 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config" (OuterVolumeSpecName: "web-config") pod "00377a2a-f108-4134-8d83-dc21e436a5e0" (UID: "00377a2a-f108-4134-8d83-dc21e436a5e0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:15.584923 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584882 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-config-volume\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.584923 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584910 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-tls-assets\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.584923 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584919 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-main-tls\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.584923 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584930 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584940 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584949 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00377a2a-f108-4134-8d83-dc21e436a5e0-metrics-client-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584957 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-alertmanager-main-db\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.584985 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.585019 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-web-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.585026 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9khd\" (UniqueName: \"kubernetes.io/projected/00377a2a-f108-4134-8d83-dc21e436a5e0-kube-api-access-m9khd\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.585034 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00377a2a-f108-4134-8d83-dc21e436a5e0-config-out\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.585219 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.585042 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00377a2a-f108-4134-8d83-dc21e436a5e0-cluster-tls-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:15.837695 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.837610 2576 generic.go:356] "Generic (PLEG): container finished" podID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerID="e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293" exitCode=0 Jun 08 13:46:15.837825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.837694 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.837825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.837696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293"} Jun 08 13:46:15.837825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.837775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00377a2a-f108-4134-8d83-dc21e436a5e0","Type":"ContainerDied","Data":"49d66cfb456eb3b7b01c81f2a8a6b532019ecf9ad0911588f9819efc2df582cc"} Jun 08 13:46:15.837933 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.837827 2576 scope.go:117] "RemoveContainer" containerID="72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907" Jun 08 13:46:15.846084 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.846061 2576 scope.go:117] "RemoveContainer" containerID="df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5" Jun 08 13:46:15.853507 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.853489 2576 scope.go:117] "RemoveContainer" containerID="00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89" Jun 08 13:46:15.863856 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.863828 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:15.865440 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.865196 2576 scope.go:117] "RemoveContainer" containerID="e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293" Jun 08 13:46:15.867606 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.867583 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:15.873191 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.873172 2576 scope.go:117] "RemoveContainer" containerID="1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f" Jun 08 13:46:15.880854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.880832 2576 scope.go:117] "RemoveContainer" containerID="bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40" Jun 08 13:46:15.888627 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.888608 2576 scope.go:117] "RemoveContainer" containerID="1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5" Jun 08 13:46:15.893499 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893472 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:15.893903 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893883 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-web" Jun 08 13:46:15.893968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893911 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-web" Jun 08 13:46:15.893968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893934 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="config-reloader" Jun 08 13:46:15.893968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893943 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="config-reloader" Jun 08 13:46:15.893968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893954 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy" Jun 08 13:46:15.893968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.893963 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894006 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="prom-label-proxy" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894014 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="prom-label-proxy" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894022 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="init-config-reloader" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894030 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="init-config-reloader" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894039 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="alertmanager" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894046 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="alertmanager" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894056 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-metric" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894065 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-metric" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894153 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-web" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894166 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="config-reloader" Jun 08 13:46:15.894176 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894174 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="prom-label-proxy" Jun 08 13:46:15.894482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894187 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="alertmanager" Jun 08 13:46:15.894482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894199 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy" Jun 08 13:46:15.894482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.894207 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" containerName="kube-rbac-proxy-metric" Jun 08 13:46:15.898279 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.898256 2576 scope.go:117] "RemoveContainer" containerID="72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907" Jun 08 13:46:15.898386 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.898296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.898679 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.898643 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907\": container with ID starting with 72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907 not found: ID does not exist" containerID="72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907" Jun 08 13:46:15.898747 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.898684 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907"} err="failed to get container status \"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907\": rpc error: code = NotFound desc = could not find container \"72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907\": container with ID starting with 72d53415216361cd44bd5d25f0b7b1bb1db987f5d4f18d8b733414dd7e5e2907 not found: ID does not exist" Jun 08 13:46:15.898747 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.898724 2576 scope.go:117] "RemoveContainer" containerID="df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5" Jun 08 13:46:15.899053 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.899024 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5\": container with ID starting with df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5 not found: ID does not exist" containerID="df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5" Jun 08 13:46:15.899144 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899062 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5"} err="failed to get container status \"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5\": rpc error: code = NotFound desc = could not find container \"df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5\": container with ID starting with df6311d2fda197e0a583b4cfa8d9947070aa8abb0ede69b879bb2b64ad26bce5 not found: ID does not exist" Jun 08 13:46:15.899144 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899087 2576 scope.go:117] "RemoveContainer" containerID="00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89" Jun 08 13:46:15.899384 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.899364 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89\": container with ID starting with 00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89 not found: ID does not exist" containerID="00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89" Jun 08 13:46:15.899457 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899389 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89"} err="failed to get container status \"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89\": rpc error: code = NotFound desc = could not find container \"00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89\": container with ID starting with 00e2e1671ca829febc12d6f738cffbcec7d54bd88113246b85b9b686f6019e89 not found: ID does not exist" Jun 08 13:46:15.899457 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899406 2576 scope.go:117] "RemoveContainer" containerID="e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293" Jun 08 13:46:15.899677 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.899660 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293\": container with ID starting with e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293 not found: ID does not exist" containerID="e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293" Jun 08 13:46:15.899716 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899683 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293"} err="failed to get container status \"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293\": rpc error: code = NotFound desc = could not find container \"e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293\": container with ID starting with e4240f836f74a64d871247acc5f2ddebc0c10498fb39ceacf588823160317293 not found: ID does not exist" Jun 08 13:46:15.899716 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899697 2576 scope.go:117] "RemoveContainer" containerID="1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f" Jun 08 13:46:15.899942 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.899926 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f\": container with ID starting with 1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f not found: ID does not exist" containerID="1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f" Jun 08 13:46:15.900016 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.899946 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f"} err="failed to get container status \"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f\": rpc error: code = NotFound desc = could not find container \"1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f\": container with ID starting with 1889f47f39b34b5f279a7dafc718664a84d445cb6f67bcd6dcc8a0e8503c6b0f not found: ID does not exist" Jun 08 13:46:15.900016 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.900007 2576 scope.go:117] "RemoveContainer" containerID="bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40" Jun 08 13:46:15.900305 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.900282 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40\": container with ID starting with bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40 not found: ID does not exist" containerID="bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40" Jun 08 13:46:15.900375 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.900309 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40"} err="failed to get container status \"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40\": rpc error: code = NotFound desc = could not find container \"bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40\": container with ID starting with bc1a5e7ae3e65d8124bd9aba38c99859f6b502a1752fface018605f600007b40 not found: ID does not exist" Jun 08 13:46:15.900375 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.900323 2576 scope.go:117] "RemoveContainer" containerID="1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5" Jun 08 13:46:15.900565 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:15.900550 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5\": container with ID starting with 1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5 not found: ID does not exist" containerID="1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5" Jun 08 13:46:15.900600 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.900568 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5"} err="failed to get container status \"1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5\": rpc error: code = NotFound desc = could not find container \"1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5\": container with ID starting with 1987a23c7d137aed82b765292b892779b77a4b2daea658c1711fdb53af739dc5 not found: ID does not exist" Jun 08 13:46:15.901336 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 13:46:15.901336 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901239 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 13:46:15.901336 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901268 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 13:46:15.901527 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m5rxs\"" Jun 08 13:46:15.901527 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901510 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 13:46:15.901632 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 13:46:15.901687 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 13:46:15.901774 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.901759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 13:46:15.902020 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.902004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 13:46:15.913331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.913299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:15.913945 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.913920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 13:46:15.988454 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988454 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gct6z\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-kube-api-access-gct6z\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-out\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988726 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-web-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:15.988960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:15.988869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.089687 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.089687 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.089912 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.089912 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gct6z\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-kube-api-access-gct6z\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.089912 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-out\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.090096 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.090096 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.089947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.090096 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.090020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.090244 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.090113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.091737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.091213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.091737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.091279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.091737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.091340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.091737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.091370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.091737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.091400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-web-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.092744 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.092712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-out\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.092960 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.092936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093101 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093215 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093215 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093491 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.093860 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.093840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.094398 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.094379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-web-config\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.095232 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.095212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.099131 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.099114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gct6z\" (UniqueName: \"kubernetes.io/projected/a75480a8-b81e-4ec8-8e7f-1d946c413ea5-kube-api-access-gct6z\") pod \"alertmanager-main-0\" (UID: \"a75480a8-b81e-4ec8-8e7f-1d946c413ea5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.212071 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.212039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:46:16.355178 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.355101 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:46:16.358011 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:46:16.357965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75480a8_b81e_4ec8_8e7f_1d946c413ea5.slice/crio-03e41d5e9a667f4b2736e14cf11926b52348ddf4f27bc71bd27914a84425b5ef WatchSource:0}: Error finding container 03e41d5e9a667f4b2736e14cf11926b52348ddf4f27bc71bd27914a84425b5ef: Status 404 returned error can't find the container with id 03e41d5e9a667f4b2736e14cf11926b52348ddf4f27bc71bd27914a84425b5ef Jun 08 13:46:16.843368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.843330 2576 generic.go:356] "Generic (PLEG): container finished" podID="a75480a8-b81e-4ec8-8e7f-1d946c413ea5" containerID="96133b167d55e65c468086c9634e52c73026ec4a0d620d4d5c77bbc7ca6f9485" exitCode=0 Jun 08 13:46:16.843762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.843419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerDied","Data":"96133b167d55e65c468086c9634e52c73026ec4a0d620d4d5c77bbc7ca6f9485"} Jun 08 13:46:16.843762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:16.843502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"03e41d5e9a667f4b2736e14cf11926b52348ddf4f27bc71bd27914a84425b5ef"} Jun 08 13:46:17.098798 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.098728 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00377a2a-f108-4134-8d83-dc21e436a5e0" path="/var/lib/kubelet/pods/00377a2a-f108-4134-8d83-dc21e436a5e0/volumes" Jun 08 13:46:17.851028 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.850976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"3258139fd5c7c9dd6a2c3bd50522872a7ff6cf7cabf982f9cc2d122d35787397"} Jun 08 13:46:17.851424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.851058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"ad6bea4bd2e8035c669ce2f9e5e167ee47e147cc040680d9a8c3cc647fa21da1"} Jun 08 13:46:17.851424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.851086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"8c9d3015af8ecb13b94894c95285be1eb51c8503c015d2daf61f0f04380cf810"} Jun 08 13:46:17.851424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.851116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"9486f8e9d6047b208e48944817e3c98af0f27842103cdd87cd14c9126a3945a1"} Jun 08 13:46:17.851424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.851139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"64f778d713ac890877d07e8f7109b2bd8f5ee38fb2f85bcb6d479f1c489738b9"} Jun 08 13:46:17.851424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.851166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a75480a8-b81e-4ec8-8e7f-1d946c413ea5","Type":"ContainerStarted","Data":"91c6b96960097a68282f0fe4aaa5447901450f3999a7babe96ef17d91ecb4087"} Jun 08 13:46:17.880541 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:17.880480 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.86519309 podStartE2EDuration="2.880460935s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.267845ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:46:17.878894403 +0000 UTC m=+149.169411302" watchObservedRunningTime="2026-06-08 13:46:17.880460935 +0000 UTC m=+149.170977834" Jun 08 13:46:18.388115 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388056 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388463 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="prometheus" containerID="cri-o://7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" gracePeriod=600 Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388483 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy" containerID="cri-o://0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" gracePeriod=600 Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388604 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" gracePeriod=600 Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388666 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-web" containerID="cri-o://a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" gracePeriod=600 Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388696 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="config-reloader" containerID="cri-o://ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" gracePeriod=600 Jun 08 13:46:18.388876 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.388772 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="thanos-sidecar" containerID="cri-o://74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" gracePeriod=600 Jun 08 13:46:18.648180 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.648150 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:18.817735 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817707 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.817921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817748 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.817921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.817921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817918 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.817947 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818095 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818111 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818103 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818162 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818157 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818183 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818202 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818210 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818213 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818275 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818311 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818370 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r59fh\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.818401 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818400 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818454 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs\") pod \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\" (UID: \"ffc79fa0-2b92-4599-ab76-8112afb66c1a\") " Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818565 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818809 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-metrics-client-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818829 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818846 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818861 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.818927 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.819057 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.819903 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.819390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:46:18.821220 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.821190 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.821771 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.821439 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.821912 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.821835 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.822223 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.822166 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh" (OuterVolumeSpecName: "kube-api-access-r59fh") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "kube-api-access-r59fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:46:18.822542 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.822516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.822634 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.822593 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config" (OuterVolumeSpecName: "config") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.823029 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.822980 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.823629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.823593 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:46:18.823900 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.823875 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out" (OuterVolumeSpecName: "config-out") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:46:18.824324 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.824297 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.824470 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.824452 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.824638 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.824619 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:46:18.832827 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.832802 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config" (OuterVolumeSpecName: "web-config") pod "ffc79fa0-2b92-4599-ab76-8112afb66c1a" (UID: "ffc79fa0-2b92-4599-ab76-8112afb66c1a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:46:18.859104 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859077 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" exitCode=0 Jun 08 13:46:18.859104 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859103 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" exitCode=0 Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859112 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" exitCode=0 Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859120 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" exitCode=0 Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859127 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" exitCode=0 Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859135 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" exitCode=0 Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859157 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859333 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859388 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} Jun 08 13:46:18.859482 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.859435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffc79fa0-2b92-4599-ab76-8112afb66c1a","Type":"ContainerDied","Data":"005a2b74786e27d09741182ec942b787d25ade90060759ce813d3ee3843e45ef"} Jun 08 13:46:18.869212 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.869120 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.876847 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.876830 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.883525 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.883508 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.889063 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.888981 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:18.893450 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.893429 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.893760 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.893733 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:18.900351 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.900332 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.907675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.907661 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.915002 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.914969 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.915293 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.915271 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.915340 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915305 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.915340 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915325 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.915560 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.915545 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.915624 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915564 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.915624 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915577 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.915781 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.915763 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.915842 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915790 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.915842 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.915813 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.916086 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.916060 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.916132 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916091 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.916132 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916109 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.916345 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.916325 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.916390 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916351 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.916390 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916366 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.916601 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.916584 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.916661 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916610 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.916661 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916631 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.916873 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:46:18.916858 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.916911 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916877 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.916911 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.916890 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.917378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917362 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.917378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917378 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.917594 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917577 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.917661 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917596 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.917818 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917801 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.917857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.917820 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.918066 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918050 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.918107 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918066 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.918269 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918253 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.918311 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918269 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.918452 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918436 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.918498 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918452 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.918630 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918615 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.918673 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918630 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.918803 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918788 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.918846 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918803 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.919012 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.918976 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.919075 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919013 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.919229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919214 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.919284 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919229 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.919400 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919379 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.919461 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919402 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.919461 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919441 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r59fh\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-kube-api-access-r59fh\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919461 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919455 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-grpc-tls\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919464 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-db\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919477 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffc79fa0-2b92-4599-ab76-8112afb66c1a-tls-assets\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919490 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-metrics-client-certs\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919504 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffc79fa0-2b92-4599-ab76-8112afb66c1a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919518 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919531 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config-out\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919543 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919559 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919558 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-web-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919573 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919585 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919594 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919602 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffc79fa0-2b92-4599-ab76-8112afb66c1a-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919629 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.919832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919644 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.920075 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919841 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.920075 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.919855 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.920153 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920063 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.920153 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920086 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.920293 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920273 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.920345 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920295 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.920551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920531 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.920628 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920552 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.920739 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920722 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.920840 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.920741 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.921339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.921312 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.921483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.921341 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.921857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.921831 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.921857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.921857 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.922183 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922161 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.922183 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922184 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.922400 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922384 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.922451 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922407 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.922630 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922615 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.922681 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922629 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.922855 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922832 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.922933 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.922858 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.923115 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923095 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.923197 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923116 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.923331 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923307 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.923385 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923333 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.923462 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923446 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:18.923527 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923507 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.923588 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923533 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.923723 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923705 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.923790 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923724 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.923790 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923787 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="config-reloader" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923798 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="config-reloader" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="init-config-reloader" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923817 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="init-config-reloader" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923831 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="prometheus" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923840 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="prometheus" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923848 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-web" Jun 08 13:46:18.923870 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923855 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-web" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923874 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="thanos-sidecar" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923883 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="thanos-sidecar" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923893 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923903 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923914 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-thanos" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923920 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-thanos" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923925 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923940 2576 scope.go:117] "RemoveContainer" containerID="bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923967 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-thanos" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923975 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.923981 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="kube-rbac-proxy-web" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924004 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="thanos-sidecar" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924014 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="config-reloader" Jun 08 13:46:18.924139 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924023 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" containerName="prometheus" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924161 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53"} err="failed to get container status \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": rpc error: code = NotFound desc = could not find container \"bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53\": container with ID starting with bd28e76c9741a4e6aa03740bb8a5cc6a6bc5657b6141c71c65644981a9802f53 not found: ID does not exist" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924174 2576 scope.go:117] "RemoveContainer" containerID="0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924332 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c"} err="failed to get container status \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": rpc error: code = NotFound desc = could not find container \"0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c\": container with ID starting with 0a527554ae0550b4df1e6a11997441e62757e4a51139e884dce5e9282ffb881c not found: ID does not exist" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924346 2576 scope.go:117] "RemoveContainer" containerID="a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924497 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f"} err="failed to get container status \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": rpc error: code = NotFound desc = could not find container \"a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f\": container with ID starting with a02eae7a9b85e7f23044196fc82ca66586df853727cb3c4248c76a4a03c6d39f not found: ID does not exist" Jun 08 13:46:18.924612 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924507 2576 scope.go:117] "RemoveContainer" containerID="74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a" Jun 08 13:46:18.924877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924678 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a"} err="failed to get container status \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": rpc error: code = NotFound desc = could not find container \"74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a\": container with ID starting with 74f16357f1083b594d72e5f85379049bdc829ff1bd00a9c88a479d3aa55be29a not found: ID does not exist" Jun 08 13:46:18.924877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924695 2576 scope.go:117] "RemoveContainer" containerID="ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487" Jun 08 13:46:18.924877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924865 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487"} err="failed to get container status \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": rpc error: code = NotFound desc = could not find container \"ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487\": container with ID starting with ea1fd73e654aa41ac9c3e090886b5476b2b5aeaf40186c7e02d2890497929487 not found: ID does not exist" Jun 08 13:46:18.924877 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.924877 2576 scope.go:117] "RemoveContainer" containerID="7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54" Jun 08 13:46:18.925126 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.925104 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54"} err="failed to get container status \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": rpc error: code = NotFound desc = could not find container \"7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54\": container with ID starting with 7b6534d8b55e3e45189f4a84ed351d297d3a79954055204dbea4ddc3bfe2de54 not found: ID does not exist" Jun 08 13:46:18.925168 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.925129 2576 scope.go:117] "RemoveContainer" containerID="923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4" Jun 08 13:46:18.925350 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.925329 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4"} err="failed to get container status \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": rpc error: code = NotFound desc = could not find container \"923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4\": container with ID starting with 923d4699ae8e113d6cc1110da7aac8950249762cd7189ab0a3f622dc544181f4 not found: ID does not exist" Jun 08 13:46:18.929702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.929685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:18.933177 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 13:46:18.933394 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 13:46:18.933474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933407 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 13:46:18.933474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933436 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 13:46:18.933590 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933578 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 13:46:18.933714 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 13:46:18.933774 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 13:46:18.933857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 13:46:18.933857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933777 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 13:46:18.933857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 13:46:18.933857 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 13:46:18.934078 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933890 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8d999\"" Jun 08 13:46:18.934078 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.933890 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9gk6alttkf70c\"" Jun 08 13:46:18.934496 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.934479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 13:46:18.939582 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.939565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 13:46:18.941229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.941214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 13:46:18.944713 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:18.944695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:19.020157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-web-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020813 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020813 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020924 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.020924 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-config-out\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.021069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.020937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.021069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.021015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwggj\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-kube-api-access-dwggj\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.021136 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.021101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.021136 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.021124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.021206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.021139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.099495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.099466 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffc79fa0-2b92-4599-ab76-8112afb66c1a" path="/var/lib/kubelet/pods/ffc79fa0-2b92-4599-ab76-8112afb66c1a/volumes" Jun 08 13:46:19.126334 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-config-out\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwggj\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-kube-api-access-dwggj\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126782 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126840 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.126840 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.126947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-web-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.127551 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.127252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.129341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.129313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-config-out\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.129812 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.129690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.129812 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.129711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130190 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.130816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.130805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.131781 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.131651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.131781 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.131670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.131781 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.131657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.132397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.132353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d80ca5-bb9e-48ad-a338-234e827fe20c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.132608 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.132565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.132720 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.132699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.133156 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.133134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.133492 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.133471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.134222 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.134200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51d80ca5-bb9e-48ad-a338-234e827fe20c-web-config\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.135851 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.135833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwggj\" (UniqueName: \"kubernetes.io/projected/51d80ca5-bb9e-48ad-a338-234e827fe20c-kube-api-access-dwggj\") pod \"prometheus-k8s-0\" (UID: \"51d80ca5-bb9e-48ad-a338-234e827fe20c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.239520 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.239440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:46:19.381936 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.381902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:46:19.385265 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:46:19.385232 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d80ca5_bb9e_48ad_a338_234e827fe20c.slice/crio-18415e1fb8aaf00fbde6b864194ae5997466235b0176fad211027346bf16fa09 WatchSource:0}: Error finding container 18415e1fb8aaf00fbde6b864194ae5997466235b0176fad211027346bf16fa09: Status 404 returned error can't find the container with id 18415e1fb8aaf00fbde6b864194ae5997466235b0176fad211027346bf16fa09 Jun 08 13:46:19.867703 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.867611 2576 generic.go:356] "Generic (PLEG): container finished" podID="51d80ca5-bb9e-48ad-a338-234e827fe20c" containerID="0a0be02e3acab8bfc9691228e8626a16d2248de61de151b2effcff2e4c774f3a" exitCode=0 Jun 08 13:46:19.868135 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.867703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerDied","Data":"0a0be02e3acab8bfc9691228e8626a16d2248de61de151b2effcff2e4c774f3a"} Jun 08 13:46:19.868135 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:19.867784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"18415e1fb8aaf00fbde6b864194ae5997466235b0176fad211027346bf16fa09"} Jun 08 13:46:20.876229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"d944ddb9ce573aac9205de48f08ad426182cb3138f67a18c715f9cee1e778510"} Jun 08 13:46:20.876849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"c66e45f400eb684982be90b67d9921e8bc56ec5d9a0f4c12385f61e9d86364bc"} Jun 08 13:46:20.876849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"25da56cd6f554625eccefdebe30aceb5d212be30a703f9d012b69d703006535c"} Jun 08 13:46:20.876849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"a3146517c007ac021f1d2a473cadd218950e1e60521bf40f4510ae00699ea578"} Jun 08 13:46:20.876849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"a2c523e6488330049fd0d615d6c5935ea20b7938a7d993674b488e005d8b43c8"} Jun 08 13:46:20.876849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.876365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51d80ca5-bb9e-48ad-a338-234e827fe20c","Type":"ContainerStarted","Data":"12250476b436a85393ee46a2bcc1229d04da84387aa1f2119b1173c9a6b31980"} Jun 08 13:46:20.918300 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:20.918225 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.899290535 podStartE2EDuration="2.918197914s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.907379ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:46:20.916586978 +0000 UTC m=+152.207103888" watchObservedRunningTime="2026-06-08 13:46:20.918197914 +0000 UTC m=+152.208714814" Jun 08 13:46:24.239854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:46:24.239815 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:47:19.239613 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:19.239584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:47:19.255528 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:19.255507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:47:20.130792 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:20.130766 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:47:35.497563 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.497534 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm"] Jun 08 13:47:35.500638 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.500622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.503581 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.503558 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 13:47:35.504760 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.504739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-m6hvf\"" Jun 08 13:47:35.504896 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.504770 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 13:47:35.514361 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.514340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm"] Jun 08 13:47:35.547659 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.547632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.547762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.547688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjqj\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-kube-api-access-pvjqj\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.648566 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.648540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjqj\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-kube-api-access-pvjqj\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.648660 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.648599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.657184 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.657157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.657300 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.657281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjqj\" (UniqueName: \"kubernetes.io/projected/16c2f771-ba64-43e6-b33b-be2ad31210a3-kube-api-access-pvjqj\") pod \"cert-manager-webhook-7dc76cbb94-qrhhm\" (UID: \"16c2f771-ba64-43e6-b33b-be2ad31210a3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.820251 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.820194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:35.949931 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:35.949903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm"] Jun 08 13:47:35.953406 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:47:35.953367 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16c2f771_ba64_43e6_b33b_be2ad31210a3.slice/crio-40a99eb05f77629e734d3fc7e266973de1ea19fd2e1741bca42e6f9fe4ca2e73 WatchSource:0}: Error finding container 40a99eb05f77629e734d3fc7e266973de1ea19fd2e1741bca42e6f9fe4ca2e73: Status 404 returned error can't find the container with id 40a99eb05f77629e734d3fc7e266973de1ea19fd2e1741bca42e6f9fe4ca2e73 Jun 08 13:47:36.185697 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:36.185669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" event={"ID":"16c2f771-ba64-43e6-b33b-be2ad31210a3","Type":"ContainerStarted","Data":"40a99eb05f77629e734d3fc7e266973de1ea19fd2e1741bca42e6f9fe4ca2e73"} Jun 08 13:47:40.204494 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:40.204455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" event={"ID":"16c2f771-ba64-43e6-b33b-be2ad31210a3","Type":"ContainerStarted","Data":"632039a87243f5c0eb6bd5735b2f14fed56d9ee00087a6e66f510738508f8185"} Jun 08 13:47:40.204874 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:40.204532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:40.225174 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:40.225125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" podStartSLOduration=1.7353571429999999 podStartE2EDuration="5.225110505s" totalImagesPullingTime="3.489753362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:40.223684281 +0000 UTC m=+231.514201177" watchObservedRunningTime="2026-06-08 13:47:40.225110505 +0000 UTC m=+231.515627401" Jun 08 13:47:46.211426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:46.211396 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qrhhm" Jun 08 13:47:51.141231 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.141193 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw"] Jun 08 13:47:51.144587 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.144569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.147510 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.147489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bq6dh\"" Jun 08 13:47:51.147611 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.147591 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:47:51.148623 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.148604 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 13:47:51.157718 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.157693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw"] Jun 08 13:47:51.270460 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.270435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8800c138-b3ee-42a8-82d2-086e7d49f1d9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.270633 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.270460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf5rl\" (UniqueName: \"kubernetes.io/projected/8800c138-b3ee-42a8-82d2-086e7d49f1d9-kube-api-access-pf5rl\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.371737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.371714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8800c138-b3ee-42a8-82d2-086e7d49f1d9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.371828 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.371742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf5rl\" (UniqueName: \"kubernetes.io/projected/8800c138-b3ee-42a8-82d2-086e7d49f1d9-kube-api-access-pf5rl\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.372073 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.372048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8800c138-b3ee-42a8-82d2-086e7d49f1d9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.380962 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.380942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf5rl\" (UniqueName: \"kubernetes.io/projected/8800c138-b3ee-42a8-82d2-086e7d49f1d9-kube-api-access-pf5rl\") pod \"openshift-lws-operator-fd8ccff4c-6bqzw\" (UID: \"8800c138-b3ee-42a8-82d2-086e7d49f1d9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.454352 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.454330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" Jun 08 13:47:51.580538 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:51.580446 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw"] Jun 08 13:47:51.582852 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:47:51.582828 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8800c138_b3ee_42a8_82d2_086e7d49f1d9.slice/crio-cfb060b2437679cd9830c9a9efd970cb1803bbbe9032ac396fc64600a260a924 WatchSource:0}: Error finding container cfb060b2437679cd9830c9a9efd970cb1803bbbe9032ac396fc64600a260a924: Status 404 returned error can't find the container with id cfb060b2437679cd9830c9a9efd970cb1803bbbe9032ac396fc64600a260a924 Jun 08 13:47:52.255705 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:52.255670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" event={"ID":"8800c138-b3ee-42a8-82d2-086e7d49f1d9","Type":"ContainerStarted","Data":"cfb060b2437679cd9830c9a9efd970cb1803bbbe9032ac396fc64600a260a924"} Jun 08 13:47:55.272230 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:55.272200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" event={"ID":"8800c138-b3ee-42a8-82d2-086e7d49f1d9","Type":"ContainerStarted","Data":"7544bee18a6db0c278a52f19017ad3136ab555039b668174831eff21ba572dc6"} Jun 08 13:47:55.290090 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:47:55.290047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6bqzw" podStartSLOduration=0.996242002 podStartE2EDuration="4.290032973s" totalImagesPullingTime="3.293790971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:55.288932767 +0000 UTC m=+246.579449665" watchObservedRunningTime="2026-06-08 13:47:55.290032973 +0000 UTC m=+246.580549869" Jun 08 13:48:11.516226 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.516152 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8"] Jun 08 13:48:11.519636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.519616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.523116 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.523090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:48:11.523116 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.523106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-smp67\"" Jun 08 13:48:11.523426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.523406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:48:11.523727 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.523712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:48:11.523777 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.523715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:48:11.544753 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.544726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8"] Jun 08 13:48:11.632255 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.632223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.632255 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.632254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.632438 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.632288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.632438 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.632346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.632438 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.632394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghsz\" (UniqueName: \"kubernetes.io/projected/b47fe5c6-3500-4337-a043-e79fa0feeb63-kube-api-access-9ghsz\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.733736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.733707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.733854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.733756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghsz\" (UniqueName: \"kubernetes.io/projected/b47fe5c6-3500-4337-a043-e79fa0feeb63-kube-api-access-9ghsz\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.733854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.733785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.733854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.733802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.733854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.733834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.734166 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.734147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.736261 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.736236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47fe5c6-3500-4337-a043-e79fa0feeb63-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.736354 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.736311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.736354 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.736329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47fe5c6-3500-4337-a043-e79fa0feeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.749376 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.749355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghsz\" (UniqueName: \"kubernetes.io/projected/b47fe5c6-3500-4337-a043-e79fa0feeb63-kube-api-access-9ghsz\") pod \"opendatahub-operator-controller-manager-85cc8d7945-nbql8\" (UID: \"b47fe5c6-3500-4337-a043-e79fa0feeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:11.829426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:11.829364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:12.017335 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:12.017310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8"] Jun 08 13:48:12.019672 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:48:12.019650 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47fe5c6_3500_4337_a043_e79fa0feeb63.slice/crio-47df6f85da29a59b62cf0d5b4916d79e3c66a7365fbf580d5256e826e8c58223 WatchSource:0}: Error finding container 47df6f85da29a59b62cf0d5b4916d79e3c66a7365fbf580d5256e826e8c58223: Status 404 returned error can't find the container with id 47df6f85da29a59b62cf0d5b4916d79e3c66a7365fbf580d5256e826e8c58223 Jun 08 13:48:12.343454 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:12.343419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" event={"ID":"b47fe5c6-3500-4337-a043-e79fa0feeb63","Type":"ContainerStarted","Data":"47df6f85da29a59b62cf0d5b4916d79e3c66a7365fbf580d5256e826e8c58223"} Jun 08 13:48:15.361476 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:15.361443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" event={"ID":"b47fe5c6-3500-4337-a043-e79fa0feeb63","Type":"ContainerStarted","Data":"6e2d1a5fde2cc14fbc81d85a9adccb7cfffb061ff5b49675d601d849b05764d3"} Jun 08 13:48:16.368334 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:16.368301 2576 generic.go:356] "Generic (PLEG): container finished" podID="b47fe5c6-3500-4337-a043-e79fa0feeb63" containerID="6e2d1a5fde2cc14fbc81d85a9adccb7cfffb061ff5b49675d601d849b05764d3" exitCode=0 Jun 08 13:48:16.368713 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:16.368384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" event={"ID":"b47fe5c6-3500-4337-a043-e79fa0feeb63","Type":"ContainerDied","Data":"6e2d1a5fde2cc14fbc81d85a9adccb7cfffb061ff5b49675d601d849b05764d3"} Jun 08 13:48:17.374295 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:17.374262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" event={"ID":"b47fe5c6-3500-4337-a043-e79fa0feeb63","Type":"ContainerStarted","Data":"f0d1aa83ba379c3bbd6bc080af409463064b272a72168783d876fcd4a14d9134"} Jun 08 13:48:17.374751 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:17.374381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:17.402745 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:17.402701 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" podStartSLOduration=2.309244707 podStartE2EDuration="6.402685687s" totalImagesPullingTime="3.131540348s" totalInitContainerRuntime="961.900632ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:17.400244567 +0000 UTC m=+268.690761466" watchObservedRunningTime="2026-06-08 13:48:17.402685687 +0000 UTC m=+268.693202583" Jun 08 13:48:28.381687 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:28.381650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-nbql8" Jun 08 13:48:30.580230 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.580199 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6"] Jun 08 13:48:30.592069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.592048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.596832 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.596813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 13:48:30.597860 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.597841 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 13:48:30.597983 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.597908 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 13:48:30.597983 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.597948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z2zs4\"" Jun 08 13:48:30.611028 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.611003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6"] Jun 08 13:48:30.686263 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.686239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6qlq\" (UniqueName: \"kubernetes.io/projected/52d3092d-c53b-43b3-87a3-74d99089aae9-kube-api-access-w6qlq\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.686388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.686299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.686388 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.686355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d3092d-c53b-43b3-87a3-74d99089aae9-manager-config\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.686480 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.686435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-metrics-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.786756 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.786730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d3092d-c53b-43b3-87a3-74d99089aae9-manager-config\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.786862 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.786770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-metrics-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.786862 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.786795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6qlq\" (UniqueName: \"kubernetes.io/projected/52d3092d-c53b-43b3-87a3-74d99089aae9-kube-api-access-w6qlq\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.787037 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.786980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.787456 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.787430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d3092d-c53b-43b3-87a3-74d99089aae9-manager-config\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.789300 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.789278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-metrics-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.789509 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.789493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d3092d-c53b-43b3-87a3-74d99089aae9-cert\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.807494 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.807471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6qlq\" (UniqueName: \"kubernetes.io/projected/52d3092d-c53b-43b3-87a3-74d99089aae9-kube-api-access-w6qlq\") pod \"lws-controller-manager-687f69c5df-kwgv6\" (UID: \"52d3092d-c53b-43b3-87a3-74d99089aae9\") " pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:30.901968 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:30.901943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:31.077397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:31.077365 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6"] Jun 08 13:48:31.080547 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:48:31.080519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d3092d_c53b_43b3_87a3_74d99089aae9.slice/crio-87a69b1c8abbd1fbf4bc2838cbb325714e262b96aa28dcd72f98602450da7808 WatchSource:0}: Error finding container 87a69b1c8abbd1fbf4bc2838cbb325714e262b96aa28dcd72f98602450da7808: Status 404 returned error can't find the container with id 87a69b1c8abbd1fbf4bc2838cbb325714e262b96aa28dcd72f98602450da7808 Jun 08 13:48:31.438745 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:31.438710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" event={"ID":"52d3092d-c53b-43b3-87a3-74d99089aae9","Type":"ContainerStarted","Data":"87a69b1c8abbd1fbf4bc2838cbb325714e262b96aa28dcd72f98602450da7808"} Jun 08 13:48:33.450260 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:33.450227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" event={"ID":"52d3092d-c53b-43b3-87a3-74d99089aae9","Type":"ContainerStarted","Data":"9a34690bdaf3ac13db16b3263120cde10156bf1c3385af4180fddbecd9752a79"} Jun 08 13:48:33.450648 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:33.450301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:33.469371 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:33.469325 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" podStartSLOduration=1.680899945 podStartE2EDuration="3.469311525s" totalImagesPullingTime="1.78841158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:33.466892027 +0000 UTC m=+284.757408936" watchObservedRunningTime="2026-06-08 13:48:33.469311525 +0000 UTC m=+284.759828421" Jun 08 13:48:42.277814 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.277779 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk"] Jun 08 13:48:42.281101 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.281084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.289040 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.289014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 13:48:42.290266 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.290248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bbjdz\"" Jun 08 13:48:42.290368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.290275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:48:42.290368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.290275 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 13:48:42.290368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.290338 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:48:42.303520 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.303484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk"] Jun 08 13:48:42.393572 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.393538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/187d96e2-cd9d-42b9-a979-10703aada256-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.393725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.393593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzgfd\" (UniqueName: \"kubernetes.io/projected/187d96e2-cd9d-42b9-a979-10703aada256-kube-api-access-kzgfd\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.393725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.393665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187d96e2-cd9d-42b9-a979-10703aada256-tmp\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.494100 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.494065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187d96e2-cd9d-42b9-a979-10703aada256-tmp\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.494281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.494146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/187d96e2-cd9d-42b9-a979-10703aada256-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.494281 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.494202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzgfd\" (UniqueName: \"kubernetes.io/projected/187d96e2-cd9d-42b9-a979-10703aada256-kube-api-access-kzgfd\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.496494 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.496467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187d96e2-cd9d-42b9-a979-10703aada256-tmp\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.497113 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.497090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/187d96e2-cd9d-42b9-a979-10703aada256-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.508224 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.508195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzgfd\" (UniqueName: \"kubernetes.io/projected/187d96e2-cd9d-42b9-a979-10703aada256-kube-api-access-kzgfd\") pod \"kube-auth-proxy-576c89d9d8-j4ztk\" (UID: \"187d96e2-cd9d-42b9-a979-10703aada256\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.590237 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.590182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" Jun 08 13:48:42.741819 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:42.741791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk"] Jun 08 13:48:42.743897 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:48:42.743873 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187d96e2_cd9d_42b9_a979_10703aada256.slice/crio-7674c8ea84b59a42aecd30ed5a7d3c30a43f1c5d51cfeb94f79da32e70c56d63 WatchSource:0}: Error finding container 7674c8ea84b59a42aecd30ed5a7d3c30a43f1c5d51cfeb94f79da32e70c56d63: Status 404 returned error can't find the container with id 7674c8ea84b59a42aecd30ed5a7d3c30a43f1c5d51cfeb94f79da32e70c56d63 Jun 08 13:48:43.505194 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:43.505091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" event={"ID":"187d96e2-cd9d-42b9-a979-10703aada256","Type":"ContainerStarted","Data":"7674c8ea84b59a42aecd30ed5a7d3c30a43f1c5d51cfeb94f79da32e70c56d63"} Jun 08 13:48:44.458137 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:44.458106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-687f69c5df-kwgv6" Jun 08 13:48:46.521890 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:46.521858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" event={"ID":"187d96e2-cd9d-42b9-a979-10703aada256","Type":"ContainerStarted","Data":"e89712fae292b41c37155a838fd1577826bdb8c9064b3d4774a0b14fde5c49ad"} Jun 08 13:48:46.570424 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:46.570374 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-j4ztk" podStartSLOduration=1.337506695 podStartE2EDuration="4.570357855s" totalImagesPullingTime="3.23285116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:46.568817724 +0000 UTC m=+297.859334625" watchObservedRunningTime="2026-06-08 13:48:46.570357855 +0000 UTC m=+297.860874829" Jun 08 13:48:49.058676 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:48:49.058652 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:50:08.774421 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.774390 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9"] Jun 08 13:50:08.777762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.777746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:08.781059 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.781028 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:50:08.782130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.782111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lsn2d\"" Jun 08 13:50:08.782130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.782127 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:50:08.793198 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.793179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9"] Jun 08 13:50:08.866213 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.866187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pmnr\" (UniqueName: \"kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr\") pod \"limitador-operator-controller-manager-859d7b78bd-l4vt9\" (UID: \"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:08.966908 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.966886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pmnr\" (UniqueName: \"kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr\") pod \"limitador-operator-controller-manager-859d7b78bd-l4vt9\" (UID: \"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:08.979386 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:08.979356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pmnr\" (UniqueName: \"kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr\") pod \"limitador-operator-controller-manager-859d7b78bd-l4vt9\" (UID: \"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:09.087249 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:09.087189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:09.230197 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:09.230176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9"] Jun 08 13:50:09.232144 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:50:09.232103 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7fb8a3_483d_4c1b_8f11_0d4ea61374b9.slice/crio-ae91e4b2654913ac8953408836d8dd1c5e51994a108f502097fa0278b3de5537 WatchSource:0}: Error finding container ae91e4b2654913ac8953408836d8dd1c5e51994a108f502097fa0278b3de5537: Status 404 returned error can't find the container with id ae91e4b2654913ac8953408836d8dd1c5e51994a108f502097fa0278b3de5537 Jun 08 13:50:09.234172 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:09.234150 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:50:09.885831 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:09.885800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" event={"ID":"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9","Type":"ContainerStarted","Data":"ae91e4b2654913ac8953408836d8dd1c5e51994a108f502097fa0278b3de5537"} Jun 08 13:50:11.896521 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:11.896483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" event={"ID":"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9","Type":"ContainerStarted","Data":"a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49"} Jun 08 13:50:11.896939 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:11.896583 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:11.927345 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:11.927303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" podStartSLOduration=1.934026576 podStartE2EDuration="3.927289259s" totalImagesPullingTime="1.993262683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:11.92222749 +0000 UTC m=+383.212744386" watchObservedRunningTime="2026-06-08 13:50:11.927289259 +0000 UTC m=+383.217806155" Jun 08 13:50:22.903316 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:22.903291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:24.860036 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.860006 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9"] Jun 08 13:50:24.860459 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.860218 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" containerName="manager" containerID="cri-o://a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49" gracePeriod=2 Jun 08 13:50:24.882932 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.882905 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9"] Jun 08 13:50:24.899648 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:50:24.899618 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-l4vt9\": pods \"limitador-operator-controller-manager-859d7b78bd-l4vt9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:24.915450 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.915427 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw"] Jun 08 13:50:24.915780 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.915768 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" containerName="manager" Jun 08 13:50:24.915824 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.915782 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" containerName="manager" Jun 08 13:50:24.915859 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.915836 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" containerName="manager" Jun 08 13:50:24.918814 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.918796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:24.939703 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:24.939678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw"] Jun 08 13:50:24.961580 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:50:24.961550 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l4vt9\" is forbidden: User \"system:node:ip-10-0-141-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-94.ec2.internal' and this object" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:25.100397 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.100366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzl8n\" (UniqueName: \"kubernetes.io/projected/9860d5ba-74a9-495e-9bc4-2341b7a17dfb-kube-api-access-dzl8n\") pod \"limitador-operator-controller-manager-859d7b78bd-qkvmw\" (UID: \"9860d5ba-74a9-495e-9bc4-2341b7a17dfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:25.105044 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.105024 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:25.200756 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.200732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pmnr\" (UniqueName: \"kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr\") pod \"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\" (UID: \"2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9\") " Jun 08 13:50:25.200859 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.200814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzl8n\" (UniqueName: \"kubernetes.io/projected/9860d5ba-74a9-495e-9bc4-2341b7a17dfb-kube-api-access-dzl8n\") pod \"limitador-operator-controller-manager-859d7b78bd-qkvmw\" (UID: \"9860d5ba-74a9-495e-9bc4-2341b7a17dfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:25.202734 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.202712 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr" (OuterVolumeSpecName: "kube-api-access-5pmnr") pod "2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" (UID: "2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9"). InnerVolumeSpecName "kube-api-access-5pmnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:25.214636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.214618 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzl8n\" (UniqueName: \"kubernetes.io/projected/9860d5ba-74a9-495e-9bc4-2341b7a17dfb-kube-api-access-dzl8n\") pod \"limitador-operator-controller-manager-859d7b78bd-qkvmw\" (UID: \"9860d5ba-74a9-495e-9bc4-2341b7a17dfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:25.234597 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.234578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:25.302225 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.302201 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pmnr\" (UniqueName: \"kubernetes.io/projected/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9-kube-api-access-5pmnr\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:50:25.377615 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.377587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw"] Jun 08 13:50:25.380132 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:50:25.380100 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9860d5ba_74a9_495e_9bc4_2341b7a17dfb.slice/crio-47cf5b719708138cdd06d475c589386c354261dc081b9d41d73ba07c161eb94f WatchSource:0}: Error finding container 47cf5b719708138cdd06d475c589386c354261dc081b9d41d73ba07c161eb94f: Status 404 returned error can't find the container with id 47cf5b719708138cdd06d475c589386c354261dc081b9d41d73ba07c161eb94f Jun 08 13:50:25.959655 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.959617 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" containerID="a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49" exitCode=0 Jun 08 13:50:25.960078 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.959664 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l4vt9" Jun 08 13:50:25.960078 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.959719 2576 scope.go:117] "RemoveContainer" containerID="a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49" Jun 08 13:50:25.961459 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.961436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" event={"ID":"9860d5ba-74a9-495e-9bc4-2341b7a17dfb","Type":"ContainerStarted","Data":"5b23fb5f2db5ae1d537a7ab81f34b79059e43aef92246d9ddbf5a8cb9c10fe01"} Jun 08 13:50:25.961552 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.961486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" event={"ID":"9860d5ba-74a9-495e-9bc4-2341b7a17dfb","Type":"ContainerStarted","Data":"47cf5b719708138cdd06d475c589386c354261dc081b9d41d73ba07c161eb94f"} Jun 08 13:50:25.961552 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.961545 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:50:25.968500 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.968474 2576 scope.go:117] "RemoveContainer" containerID="a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49" Jun 08 13:50:25.968760 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:50:25.968743 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49\": container with ID starting with a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49 not found: ID does not exist" containerID="a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49" Jun 08 13:50:25.968817 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.968767 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49"} err="failed to get container status \"a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49\": rpc error: code = NotFound desc = could not find container \"a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49\": container with ID starting with a55059f1d49c10e4943f251f1b3d0e03a63b9fc1d9783983b0c72df676fc6f49 not found: ID does not exist" Jun 08 13:50:25.989721 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:25.989684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" podStartSLOduration=1.989672052 podStartE2EDuration="1.989672052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:25.989066264 +0000 UTC m=+397.279583160" watchObservedRunningTime="2026-06-08 13:50:25.989672052 +0000 UTC m=+397.280188947" Jun 08 13:50:27.099140 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:27.099111 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9" path="/var/lib/kubelet/pods/2b7fb8a3-483d-4c1b-8f11-0d4ea61374b9/volumes" Jun 08 13:50:36.969940 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:50:36.969913 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qkvmw" Jun 08 13:51:16.849841 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:16.849751 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:16.853113 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:16.853090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:16.855822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:16.855805 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-89qqw\"" Jun 08 13:51:16.858474 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:16.858452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:16.994521 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:16.994492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfnz\" (UniqueName: \"kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz\") pod \"authorino-58cd955675-xjlvt\" (UID: \"ef15f1d8-c762-41ec-81b4-dffea096a814\") " pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:17.065329 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.065290 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:51:17.068604 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.068581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:51:17.082010 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.081960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:51:17.095279 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.095253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfnz\" (UniqueName: \"kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz\") pod \"authorino-58cd955675-xjlvt\" (UID: \"ef15f1d8-c762-41ec-81b4-dffea096a814\") " pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:17.105104 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.105053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfnz\" (UniqueName: \"kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz\") pod \"authorino-58cd955675-xjlvt\" (UID: \"ef15f1d8-c762-41ec-81b4-dffea096a814\") " pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:17.162634 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.162611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:17.196326 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.196291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7t7\" (UniqueName: \"kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7\") pod \"authorino-75d556bd77-n7xcl\" (UID: \"e2dc17eb-73de-45ae-826e-c865cf2e1561\") " pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:51:17.288629 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.288606 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:17.290672 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:51:17.290646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef15f1d8_c762_41ec_81b4_dffea096a814.slice/crio-91ffcea416b69ccfbe43ef8cf54970bce19b01681c5c96d9f848560892fbb9f5 WatchSource:0}: Error finding container 91ffcea416b69ccfbe43ef8cf54970bce19b01681c5c96d9f848560892fbb9f5: Status 404 returned error can't find the container with id 91ffcea416b69ccfbe43ef8cf54970bce19b01681c5c96d9f848560892fbb9f5 Jun 08 13:51:17.297087 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.297062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7t7\" (UniqueName: \"kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7\") pod \"authorino-75d556bd77-n7xcl\" (UID: \"e2dc17eb-73de-45ae-826e-c865cf2e1561\") " pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:51:17.305507 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.305482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7t7\" (UniqueName: \"kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7\") pod \"authorino-75d556bd77-n7xcl\" (UID: \"e2dc17eb-73de-45ae-826e-c865cf2e1561\") " pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:51:17.377822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.377759 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:51:17.505657 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:17.505629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:51:17.508697 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:51:17.508671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2dc17eb_73de_45ae_826e_c865cf2e1561.slice/crio-9cc81a4f573780da8762aa3c2b23843781a70b560f324bc4234cadd8341bbb90 WatchSource:0}: Error finding container 9cc81a4f573780da8762aa3c2b23843781a70b560f324bc4234cadd8341bbb90: Status 404 returned error can't find the container with id 9cc81a4f573780da8762aa3c2b23843781a70b560f324bc4234cadd8341bbb90 Jun 08 13:51:18.198367 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:18.198331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7xcl" event={"ID":"e2dc17eb-73de-45ae-826e-c865cf2e1561","Type":"ContainerStarted","Data":"9cc81a4f573780da8762aa3c2b23843781a70b560f324bc4234cadd8341bbb90"} Jun 08 13:51:18.199910 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:18.199880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjlvt" event={"ID":"ef15f1d8-c762-41ec-81b4-dffea096a814","Type":"ContainerStarted","Data":"91ffcea416b69ccfbe43ef8cf54970bce19b01681c5c96d9f848560892fbb9f5"} Jun 08 13:51:21.242963 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:21.242925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7xcl" event={"ID":"e2dc17eb-73de-45ae-826e-c865cf2e1561","Type":"ContainerStarted","Data":"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db"} Jun 08 13:51:21.244352 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:21.244328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjlvt" event={"ID":"ef15f1d8-c762-41ec-81b4-dffea096a814","Type":"ContainerStarted","Data":"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532"} Jun 08 13:51:21.270031 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:21.269966 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n7xcl" podStartSLOduration=1.331684316 podStartE2EDuration="4.269954605s" totalImagesPullingTime="2.938270289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:21.268722269 +0000 UTC m=+452.559239144" watchObservedRunningTime="2026-06-08 13:51:21.269954605 +0000 UTC m=+452.560471501" Jun 08 13:51:21.303289 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:21.303247 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xjlvt" podStartSLOduration=2.135548882 podStartE2EDuration="5.30323418s" totalImagesPullingTime="3.167685298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:21.301756596 +0000 UTC m=+452.592273491" watchObservedRunningTime="2026-06-08 13:51:21.30323418 +0000 UTC m=+452.593751075" Jun 08 13:51:21.355323 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:21.355296 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:23.253249 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:23.253213 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xjlvt" podUID="ef15f1d8-c762-41ec-81b4-dffea096a814" containerName="authorino" containerID="cri-o://b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532" gracePeriod=30 Jun 08 13:51:23.490542 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:23.490513 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:23.560054 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:23.559977 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwfnz\" (UniqueName: \"kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz\") pod \"ef15f1d8-c762-41ec-81b4-dffea096a814\" (UID: \"ef15f1d8-c762-41ec-81b4-dffea096a814\") " Jun 08 13:51:23.562027 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:23.561983 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz" (OuterVolumeSpecName: "kube-api-access-hwfnz") pod "ef15f1d8-c762-41ec-81b4-dffea096a814" (UID: "ef15f1d8-c762-41ec-81b4-dffea096a814"). InnerVolumeSpecName "kube-api-access-hwfnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:51:23.661218 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:23.661196 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwfnz\" (UniqueName: \"kubernetes.io/projected/ef15f1d8-c762-41ec-81b4-dffea096a814-kube-api-access-hwfnz\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:51:24.258352 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.258318 2576 generic.go:356] "Generic (PLEG): container finished" podID="ef15f1d8-c762-41ec-81b4-dffea096a814" containerID="b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532" exitCode=0 Jun 08 13:51:24.258725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.258356 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjlvt" Jun 08 13:51:24.258725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.258388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjlvt" event={"ID":"ef15f1d8-c762-41ec-81b4-dffea096a814","Type":"ContainerDied","Data":"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532"} Jun 08 13:51:24.258725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.258418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjlvt" event={"ID":"ef15f1d8-c762-41ec-81b4-dffea096a814","Type":"ContainerDied","Data":"91ffcea416b69ccfbe43ef8cf54970bce19b01681c5c96d9f848560892fbb9f5"} Jun 08 13:51:24.258725 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.258432 2576 scope.go:117] "RemoveContainer" containerID="b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532" Jun 08 13:51:24.266399 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.266379 2576 scope.go:117] "RemoveContainer" containerID="b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532" Jun 08 13:51:24.266666 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:51:24.266647 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532\": container with ID starting with b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532 not found: ID does not exist" containerID="b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532" Jun 08 13:51:24.266740 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.266678 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532"} err="failed to get container status \"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532\": rpc error: code = NotFound desc = could not find container \"b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532\": container with ID starting with b89932ceeafc39d2c8a3489cbaae1e4eb5a399dd1ca4c4f562854d5c55aaf532 not found: ID does not exist" Jun 08 13:51:24.279776 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.279751 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:24.283983 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:24.283961 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjlvt"] Jun 08 13:51:25.099378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:51:25.099348 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef15f1d8-c762-41ec-81b4-dffea096a814" path="/var/lib/kubelet/pods/ef15f1d8-c762-41ec-81b4-dffea096a814/volumes" Jun 08 13:52:07.645705 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.645671 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:07.646222 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.646171 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef15f1d8-c762-41ec-81b4-dffea096a814" containerName="authorino" Jun 08 13:52:07.646222 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.646190 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef15f1d8-c762-41ec-81b4-dffea096a814" containerName="authorino" Jun 08 13:52:07.646317 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.646274 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef15f1d8-c762-41ec-81b4-dffea096a814" containerName="authorino" Jun 08 13:52:07.649076 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.649060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:07.652122 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.652102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:52:07.652226 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.652100 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:52:07.652226 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.652201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:52:07.653310 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.653297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-77ddp\"" Jun 08 13:52:07.660785 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.660767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:07.707764 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.707745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7gzn\" (UniqueName: \"kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn\") pod \"maas-keycloak-0\" (UID: \"6a3b3e59-4241-4e56-98c1-4baf9e235526\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:07.808487 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.808460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7gzn\" (UniqueName: \"kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn\") pod \"maas-keycloak-0\" (UID: \"6a3b3e59-4241-4e56-98c1-4baf9e235526\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:07.817703 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.817681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7gzn\" (UniqueName: \"kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn\") pod \"maas-keycloak-0\" (UID: \"6a3b3e59-4241-4e56-98c1-4baf9e235526\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:07.958937 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:07.958879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:08.092249 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:08.092215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:08.095567 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:52:08.095524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3b3e59_4241_4e56_98c1_4baf9e235526.slice/crio-cd4f1be0a9307970601510a166aca4fd355fd19e5dd588ab7397b8ee12f06d07 WatchSource:0}: Error finding container cd4f1be0a9307970601510a166aca4fd355fd19e5dd588ab7397b8ee12f06d07: Status 404 returned error can't find the container with id cd4f1be0a9307970601510a166aca4fd355fd19e5dd588ab7397b8ee12f06d07 Jun 08 13:52:08.452616 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:08.452577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6a3b3e59-4241-4e56-98c1-4baf9e235526","Type":"ContainerStarted","Data":"cd4f1be0a9307970601510a166aca4fd355fd19e5dd588ab7397b8ee12f06d07"} Jun 08 13:52:13.486797 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:13.486751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6a3b3e59-4241-4e56-98c1-4baf9e235526","Type":"ContainerStarted","Data":"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d"} Jun 08 13:52:13.522081 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:13.522019 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.149019663 podStartE2EDuration="6.521975802s" totalImagesPullingTime="4.372956139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:13.521211937 +0000 UTC m=+504.811728835" watchObservedRunningTime="2026-06-08 13:52:13.521975802 +0000 UTC m=+504.812492704" Jun 08 13:52:13.959816 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:13.959768 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:13.961383 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:13.961330 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:14.959635 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:14.959588 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:15.959933 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:15.959873 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:16.960272 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:16.960211 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:17.959906 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:17.959863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:17.961505 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:17.960708 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:18.960373 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:18.960314 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:19.959838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:19.959778 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:20.959888 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:20.959831 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:21.960368 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:21.960312 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:22.959800 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:22.959753 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:23.960228 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:23.960185 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:24.959366 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:24.959324 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:52:26.083780 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:26.083737 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:26.100685 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:26.100640 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:52:36.091544 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:36.091509 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:37.099332 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.099303 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:37.110109 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.110080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:37.113369 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.113341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:37.197378 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.197343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgl5d\" (UniqueName: \"kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d\") pod \"authorino-5d4b67c446-78965\" (UID: \"004da78d-716e-4773-ba6e-1ecfbf79d8cb\") " pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:37.298140 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.298107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgl5d\" (UniqueName: \"kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d\") pod \"authorino-5d4b67c446-78965\" (UID: \"004da78d-716e-4773-ba6e-1ecfbf79d8cb\") " pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:37.306767 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.306739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgl5d\" (UniqueName: \"kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d\") pod \"authorino-5d4b67c446-78965\" (UID: \"004da78d-716e-4773-ba6e-1ecfbf79d8cb\") " pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:37.339317 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.339286 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:37.339542 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.339530 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:37.363304 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.363279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:52:37.367037 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.367020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.369830 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.369812 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 13:52:37.375047 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.374985 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:52:37.399429 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.399397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zbb\" (UniqueName: \"kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.399568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.399459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.477104 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.477078 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:37.479477 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:52:37.479452 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod004da78d_716e_4773_ba6e_1ecfbf79d8cb.slice/crio-ef16c6db87b8fe21b8b11464a9a974d740359a84581e015e3692fc3d3998d60c WatchSource:0}: Error finding container ef16c6db87b8fe21b8b11464a9a974d740359a84581e015e3692fc3d3998d60c: Status 404 returned error can't find the container with id ef16c6db87b8fe21b8b11464a9a974d740359a84581e015e3692fc3d3998d60c Jun 08 13:52:37.500434 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.500412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zbb\" (UniqueName: \"kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.500607 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.500461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.502967 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.502943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.509636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.509615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zbb\" (UniqueName: \"kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb\") pod \"authorino-fcd7fd48d-p6hvc\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.633838 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.633766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-78965" event={"ID":"004da78d-716e-4773-ba6e-1ecfbf79d8cb","Type":"ContainerStarted","Data":"ef16c6db87b8fe21b8b11464a9a974d740359a84581e015e3692fc3d3998d60c"} Jun 08 13:52:37.678843 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.678816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:52:37.810850 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:37.810805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:52:37.812936 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:52:37.812910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf8a88ac_7161_4bdb_9795_841fa423dc41.slice/crio-9eb4aebf419e75f9630578ef6eef9aab056550dabb0d992c41ba6497c7ac83ff WatchSource:0}: Error finding container 9eb4aebf419e75f9630578ef6eef9aab056550dabb0d992c41ba6497c7ac83ff: Status 404 returned error can't find the container with id 9eb4aebf419e75f9630578ef6eef9aab056550dabb0d992c41ba6497c7ac83ff Jun 08 13:52:38.640153 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.640105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" event={"ID":"cf8a88ac-7161-4bdb-9795-841fa423dc41","Type":"ContainerStarted","Data":"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397"} Jun 08 13:52:38.640607 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.640198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" event={"ID":"cf8a88ac-7161-4bdb-9795-841fa423dc41","Type":"ContainerStarted","Data":"9eb4aebf419e75f9630578ef6eef9aab056550dabb0d992c41ba6497c7ac83ff"} Jun 08 13:52:38.641697 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.641663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-78965" event={"ID":"004da78d-716e-4773-ba6e-1ecfbf79d8cb","Type":"ContainerStarted","Data":"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36"} Jun 08 13:52:38.641697 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.641688 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-78965" podUID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" containerName="authorino" containerID="cri-o://c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36" gracePeriod=30 Jun 08 13:52:38.658419 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.658377 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" podStartSLOduration=1.339386197 podStartE2EDuration="1.65836139s" totalImagesPullingTime="318.975193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:38.65774103 +0000 UTC m=+529.948257929" watchObservedRunningTime="2026-06-08 13:52:38.65836139 +0000 UTC m=+529.948878286" Jun 08 13:52:38.674935 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.674880 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-78965" podStartSLOduration=1.303451104 podStartE2EDuration="1.674867474s" totalImagesPullingTime="371.41637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:38.673896391 +0000 UTC m=+529.964413289" watchObservedRunningTime="2026-06-08 13:52:38.674867474 +0000 UTC m=+529.965384371" Jun 08 13:52:38.688792 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.688766 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:52:38.688921 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.688900 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n7xcl" podUID="e2dc17eb-73de-45ae-826e-c865cf2e1561" containerName="authorino" containerID="cri-o://348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db" gracePeriod=30 Jun 08 13:52:38.958479 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.958456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:38.961477 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:38.961458 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:52:39.013584 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.013551 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgl5d\" (UniqueName: \"kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d\") pod \"004da78d-716e-4773-ba6e-1ecfbf79d8cb\" (UID: \"004da78d-716e-4773-ba6e-1ecfbf79d8cb\") " Jun 08 13:52:39.013764 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.013653 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm7t7\" (UniqueName: \"kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7\") pod \"e2dc17eb-73de-45ae-826e-c865cf2e1561\" (UID: \"e2dc17eb-73de-45ae-826e-c865cf2e1561\") " Jun 08 13:52:39.015774 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.015747 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7" (OuterVolumeSpecName: "kube-api-access-jm7t7") pod "e2dc17eb-73de-45ae-826e-c865cf2e1561" (UID: "e2dc17eb-73de-45ae-826e-c865cf2e1561"). InnerVolumeSpecName "kube-api-access-jm7t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:39.015866 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.015767 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d" (OuterVolumeSpecName: "kube-api-access-wgl5d") pod "004da78d-716e-4773-ba6e-1ecfbf79d8cb" (UID: "004da78d-716e-4773-ba6e-1ecfbf79d8cb"). InnerVolumeSpecName "kube-api-access-wgl5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:39.114390 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.114302 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgl5d\" (UniqueName: \"kubernetes.io/projected/004da78d-716e-4773-ba6e-1ecfbf79d8cb-kube-api-access-wgl5d\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:52:39.114390 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.114325 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm7t7\" (UniqueName: \"kubernetes.io/projected/e2dc17eb-73de-45ae-826e-c865cf2e1561-kube-api-access-jm7t7\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:52:39.647218 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.647189 2576 generic.go:356] "Generic (PLEG): container finished" podID="e2dc17eb-73de-45ae-826e-c865cf2e1561" containerID="348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db" exitCode=0 Jun 08 13:52:39.647654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.647244 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7xcl" Jun 08 13:52:39.647654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.647272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7xcl" event={"ID":"e2dc17eb-73de-45ae-826e-c865cf2e1561","Type":"ContainerDied","Data":"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db"} Jun 08 13:52:39.647654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.647327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7xcl" event={"ID":"e2dc17eb-73de-45ae-826e-c865cf2e1561","Type":"ContainerDied","Data":"9cc81a4f573780da8762aa3c2b23843781a70b560f324bc4234cadd8341bbb90"} Jun 08 13:52:39.647654 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.647354 2576 scope.go:117] "RemoveContainer" containerID="348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db" Jun 08 13:52:39.648703 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.648659 2576 generic.go:356] "Generic (PLEG): container finished" podID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" containerID="c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36" exitCode=0 Jun 08 13:52:39.648765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.648719 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-78965" Jun 08 13:52:39.648765 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.648731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-78965" event={"ID":"004da78d-716e-4773-ba6e-1ecfbf79d8cb","Type":"ContainerDied","Data":"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36"} Jun 08 13:52:39.648844 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.648772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-78965" event={"ID":"004da78d-716e-4773-ba6e-1ecfbf79d8cb","Type":"ContainerDied","Data":"ef16c6db87b8fe21b8b11464a9a974d740359a84581e015e3692fc3d3998d60c"} Jun 08 13:52:39.655969 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.655951 2576 scope.go:117] "RemoveContainer" containerID="348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db" Jun 08 13:52:39.656307 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:39.656289 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db\": container with ID starting with 348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db not found: ID does not exist" containerID="348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db" Jun 08 13:52:39.656362 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.656314 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db"} err="failed to get container status \"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db\": rpc error: code = NotFound desc = could not find container \"348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db\": container with ID starting with 348b0b59830135d7926d2c9c2d1952167783677fe09340b125ef6c1861f554db not found: ID does not exist" Jun 08 13:52:39.656362 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.656330 2576 scope.go:117] "RemoveContainer" containerID="c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36" Jun 08 13:52:39.664206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.664191 2576 scope.go:117] "RemoveContainer" containerID="c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36" Jun 08 13:52:39.664277 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.664265 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:52:39.664500 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:39.664484 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36\": container with ID starting with c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36 not found: ID does not exist" containerID="c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36" Jun 08 13:52:39.664545 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.664504 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36"} err="failed to get container status \"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36\": rpc error: code = NotFound desc = could not find container \"c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36\": container with ID starting with c0a2c6bf13e38f95d48a0d4cb8618ae7cbef7f508384f0c75346f60431b9bb36 not found: ID does not exist" Jun 08 13:52:39.667861 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.667841 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7xcl"] Jun 08 13:52:39.679724 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.679705 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:39.684163 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:39.684144 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-78965"] Jun 08 13:52:41.100144 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:41.100098 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" path="/var/lib/kubelet/pods/004da78d-716e-4773-ba6e-1ecfbf79d8cb/volumes" Jun 08 13:52:41.100647 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:41.100489 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2dc17eb-73de-45ae-826e-c865cf2e1561" path="/var/lib/kubelet/pods/e2dc17eb-73de-45ae-826e-c865cf2e1561/volumes" Jun 08 13:52:42.564873 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.564832 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:42.565405 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565384 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dc17eb-73de-45ae-826e-c865cf2e1561" containerName="authorino" Jun 08 13:52:42.565484 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565409 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dc17eb-73de-45ae-826e-c865cf2e1561" containerName="authorino" Jun 08 13:52:42.565484 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565427 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" containerName="authorino" Jun 08 13:52:42.565484 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565437 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" containerName="authorino" Jun 08 13:52:42.565624 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565547 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="004da78d-716e-4773-ba6e-1ecfbf79d8cb" containerName="authorino" Jun 08 13:52:42.565624 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.565563 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dc17eb-73de-45ae-826e-c865cf2e1561" containerName="authorino" Jun 08 13:52:42.569946 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.569923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.572736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.572715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:52:42.572859 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.572809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcqhl\"" Jun 08 13:52:42.573856 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.573840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:52:42.579702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.579674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:42.647390 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.647351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.647569 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.647402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rbk\" (UniqueName: \"kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.739839 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.739779 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:52:42.743252 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.743232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:42.748613 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.748587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.748769 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.748642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rbk\" (UniqueName: \"kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.748769 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:42.748748 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 13:52:42.748908 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:42.748820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert podName:ad61e928-c842-4259-a688-19348788c267 nodeName:}" failed. No retries permitted until 2026-06-08 13:52:43.248799227 +0000 UTC m=+534.539316118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert") pod "maas-controller-57956fb5c-4ncwd" (UID: "ad61e928-c842-4259-a688-19348788c267") : secret "maas-controller-webhook-cert" not found Jun 08 13:52:42.753602 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.753572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:52:42.757940 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.757913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rbk\" (UniqueName: \"kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:42.849253 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.849139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:42.849253 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.849202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgj9\" (UniqueName: \"kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:42.950660 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.950626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:42.950809 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.950670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgj9\" (UniqueName: \"kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:42.950809 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:42.950775 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 13:52:42.950901 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:42.950841 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert podName:ab462f4d-9a32-4051-8bde-e75b1665e178 nodeName:}" failed. No retries permitted until 2026-06-08 13:52:43.450825221 +0000 UTC m=+534.741342095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert") pod "maas-controller-5cdcd4fcd7-cw2nf" (UID: "ab462f4d-9a32-4051-8bde-e75b1665e178") : secret "maas-controller-webhook-cert" not found Jun 08 13:52:42.960986 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:42.960946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgj9\" (UniqueName: \"kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:43.253800 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:43.253760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:43.253983 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:43.253939 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 13:52:43.254042 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:43.254028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert podName:ad61e928-c842-4259-a688-19348788c267 nodeName:}" failed. No retries permitted until 2026-06-08 13:52:44.253985173 +0000 UTC m=+535.544502048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert") pod "maas-controller-57956fb5c-4ncwd" (UID: "ad61e928-c842-4259-a688-19348788c267") : secret "maas-controller-webhook-cert" not found Jun 08 13:52:43.455169 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:43.455122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:43.457651 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:43.457630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-cw2nf\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:43.654979 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:43.654943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:43.792252 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:43.792227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:52:43.794571 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:52:43.794543 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab462f4d_9a32_4051_8bde_e75b1665e178.slice/crio-799c1fa1410b6e59a442d376ffed0af6d3bb29f05dac7b91ed9c4b709d77fe4f WatchSource:0}: Error finding container 799c1fa1410b6e59a442d376ffed0af6d3bb29f05dac7b91ed9c4b709d77fe4f: Status 404 returned error can't find the container with id 799c1fa1410b6e59a442d376ffed0af6d3bb29f05dac7b91ed9c4b709d77fe4f Jun 08 13:52:44.263347 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.263308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:44.265897 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.265865 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"maas-controller-57956fb5c-4ncwd\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:44.381948 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.381911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:44.542475 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.542389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:44.547353 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:52:44.547326 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad61e928_c842_4259_a688_19348788c267.slice/crio-b45817d918021985d653fb614915b637b09c3e2e7553e0508b5c73b27335d396 WatchSource:0}: Error finding container b45817d918021985d653fb614915b637b09c3e2e7553e0508b5c73b27335d396: Status 404 returned error can't find the container with id b45817d918021985d653fb614915b637b09c3e2e7553e0508b5c73b27335d396 Jun 08 13:52:44.679850 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.679804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57956fb5c-4ncwd" event={"ID":"ad61e928-c842-4259-a688-19348788c267","Type":"ContainerStarted","Data":"b45817d918021985d653fb614915b637b09c3e2e7553e0508b5c73b27335d396"} Jun 08 13:52:44.681514 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:44.681480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" event={"ID":"ab462f4d-9a32-4051-8bde-e75b1665e178","Type":"ContainerStarted","Data":"799c1fa1410b6e59a442d376ffed0af6d3bb29f05dac7b91ed9c4b709d77fe4f"} Jun 08 13:52:46.697902 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.697867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57956fb5c-4ncwd" event={"ID":"ad61e928-c842-4259-a688-19348788c267","Type":"ContainerStarted","Data":"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2"} Jun 08 13:52:46.698348 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.698023 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:46.699497 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.699474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" event={"ID":"ab462f4d-9a32-4051-8bde-e75b1665e178","Type":"ContainerStarted","Data":"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e"} Jun 08 13:52:46.699605 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.699521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:46.724881 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.724793 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57956fb5c-4ncwd" podStartSLOduration=2.807027474 podStartE2EDuration="4.724774078s" totalImagesPullingTime="1.917746604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:46.724691567 +0000 UTC m=+538.015208467" watchObservedRunningTime="2026-06-08 13:52:46.724774078 +0000 UTC m=+538.015290978" Jun 08 13:52:46.745606 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:46.745545 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" podStartSLOduration=2.081078514 podStartE2EDuration="4.745523396s" totalImagesPullingTime="2.664444882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:46.744790123 +0000 UTC m=+538.035307025" watchObservedRunningTime="2026-06-08 13:52:46.745523396 +0000 UTC m=+538.036040295" Jun 08 13:52:57.712119 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:57.712091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:52:57.712527 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:57.712162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:57.773182 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:57.773151 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:57.773383 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:57.773341 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-57956fb5c-4ncwd" podUID="ad61e928-c842-4259-a688-19348788c267" containerName="manager" containerID="cri-o://ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2" gracePeriod=30 Jun 08 13:52:58.019469 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.019440 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:58.086676 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.086650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") pod \"ad61e928-c842-4259-a688-19348788c267\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " Jun 08 13:52:58.086787 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.086691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rbk\" (UniqueName: \"kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk\") pod \"ad61e928-c842-4259-a688-19348788c267\" (UID: \"ad61e928-c842-4259-a688-19348788c267\") " Jun 08 13:52:58.088844 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.088819 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ad61e928-c842-4259-a688-19348788c267" (UID: "ad61e928-c842-4259-a688-19348788c267"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:52:58.088940 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.088907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk" (OuterVolumeSpecName: "kube-api-access-d6rbk") pod "ad61e928-c842-4259-a688-19348788c267" (UID: "ad61e928-c842-4259-a688-19348788c267"). InnerVolumeSpecName "kube-api-access-d6rbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:58.187736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.187714 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad61e928-c842-4259-a688-19348788c267-webhook-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:52:58.187736 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.187734 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6rbk\" (UniqueName: \"kubernetes.io/projected/ad61e928-c842-4259-a688-19348788c267-kube-api-access-d6rbk\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:52:58.763412 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.763378 2576 generic.go:356] "Generic (PLEG): container finished" podID="ad61e928-c842-4259-a688-19348788c267" containerID="ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2" exitCode=0 Jun 08 13:52:58.763775 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.763427 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57956fb5c-4ncwd" Jun 08 13:52:58.763775 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.763465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57956fb5c-4ncwd" event={"ID":"ad61e928-c842-4259-a688-19348788c267","Type":"ContainerDied","Data":"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2"} Jun 08 13:52:58.763775 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.763518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57956fb5c-4ncwd" event={"ID":"ad61e928-c842-4259-a688-19348788c267","Type":"ContainerDied","Data":"b45817d918021985d653fb614915b637b09c3e2e7553e0508b5c73b27335d396"} Jun 08 13:52:58.763775 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.763540 2576 scope.go:117] "RemoveContainer" containerID="ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2" Jun 08 13:52:58.772813 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.772794 2576 scope.go:117] "RemoveContainer" containerID="ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2" Jun 08 13:52:58.773077 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:52:58.773057 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2\": container with ID starting with ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2 not found: ID does not exist" containerID="ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2" Jun 08 13:52:58.773130 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.773086 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2"} err="failed to get container status \"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2\": rpc error: code = NotFound desc = could not find container \"ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2\": container with ID starting with ad659effec9c271f99a9b8728078a01cfd7862c9bcb608ad0789466c61f516a2 not found: ID does not exist" Jun 08 13:52:58.786207 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.786187 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:58.792252 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:58.792229 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57956fb5c-4ncwd"] Jun 08 13:52:59.105619 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:52:59.105553 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad61e928-c842-4259-a688-19348788c267" path="/var/lib/kubelet/pods/ad61e928-c842-4259-a688-19348788c267/volumes" Jun 08 13:53:17.808470 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.808432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-c86bf48cd-gwj94"] Jun 08 13:53:17.808892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.808834 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad61e928-c842-4259-a688-19348788c267" containerName="manager" Jun 08 13:53:17.808892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.808846 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad61e928-c842-4259-a688-19348788c267" containerName="manager" Jun 08 13:53:17.808965 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.808905 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad61e928-c842-4259-a688-19348788c267" containerName="manager" Jun 08 13:53:17.812030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.812014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:17.818625 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.818302 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 13:53:17.818625 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.818325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-khrfr\"" Jun 08 13:53:17.822093 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.822070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c86bf48cd-gwj94"] Jun 08 13:53:17.949391 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.949364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:17.949535 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:17.949410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467fb\" (UniqueName: \"kubernetes.io/projected/f98d8be0-9c0c-46c3-88f0-275a86284860-kube-api-access-467fb\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.050275 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.050248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.050400 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.050288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467fb\" (UniqueName: \"kubernetes.io/projected/f98d8be0-9c0c-46c3-88f0-275a86284860-kube-api-access-467fb\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.050400 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:53:18.050390 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 08 13:53:18.050483 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:53:18.050456 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls podName:f98d8be0-9c0c-46c3-88f0-275a86284860 nodeName:}" failed. No retries permitted until 2026-06-08 13:53:18.550440883 +0000 UTC m=+569.840957762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls") pod "maas-api-c86bf48cd-gwj94" (UID: "f98d8be0-9c0c-46c3-88f0-275a86284860") : secret "maas-api-serving-cert" not found Jun 08 13:53:18.062842 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.062788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-467fb\" (UniqueName: \"kubernetes.io/projected/f98d8be0-9c0c-46c3-88f0-275a86284860-kube-api-access-467fb\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.344875 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.344797 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-bcdcn"] Jun 08 13:53:18.348339 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.348323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:18.351757 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.351735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 13:53:18.351956 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.351942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xdw6d\"" Jun 08 13:53:18.360489 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.360467 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-bcdcn"] Jun 08 13:53:18.453793 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.453761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j47f\" (UniqueName: \"kubernetes.io/projected/1c090839-8dee-4841-ae2a-c3b17d66ae52-kube-api-access-7j47f\") pod \"payload-pre-processing-67d7689b65-bcdcn\" (UID: \"1c090839-8dee-4841-ae2a-c3b17d66ae52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:18.555246 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.555214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j47f\" (UniqueName: \"kubernetes.io/projected/1c090839-8dee-4841-ae2a-c3b17d66ae52-kube-api-access-7j47f\") pod \"payload-pre-processing-67d7689b65-bcdcn\" (UID: \"1c090839-8dee-4841-ae2a-c3b17d66ae52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:18.555428 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.555267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.558055 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.558022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f98d8be0-9c0c-46c3-88f0-275a86284860-maas-api-tls\") pod \"maas-api-c86bf48cd-gwj94\" (UID: \"f98d8be0-9c0c-46c3-88f0-275a86284860\") " pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.566066 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.566027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j47f\" (UniqueName: \"kubernetes.io/projected/1c090839-8dee-4841-ae2a-c3b17d66ae52-kube-api-access-7j47f\") pod \"payload-pre-processing-67d7689b65-bcdcn\" (UID: \"1c090839-8dee-4841-ae2a-c3b17d66ae52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:18.658864 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.658841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:18.722569 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.722536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:18.805241 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.805204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-bcdcn"] Jun 08 13:53:18.813444 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:53:18.813414 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c090839_8dee_4841_ae2a_c3b17d66ae52.slice/crio-0d69215c9fd5714339b1391746dbe8bf95ad0eb253df52fa228c2506e9d987f3 WatchSource:0}: Error finding container 0d69215c9fd5714339b1391746dbe8bf95ad0eb253df52fa228c2506e9d987f3: Status 404 returned error can't find the container with id 0d69215c9fd5714339b1391746dbe8bf95ad0eb253df52fa228c2506e9d987f3 Jun 08 13:53:18.865597 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.865576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c86bf48cd-gwj94"] Jun 08 13:53:18.868421 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:53:18.868386 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98d8be0_9c0c_46c3_88f0_275a86284860.slice/crio-ea831efcce46316f2c86f944125b459ef3af04d296baca857d703efe7c755207 WatchSource:0}: Error finding container ea831efcce46316f2c86f944125b459ef3af04d296baca857d703efe7c755207: Status 404 returned error can't find the container with id ea831efcce46316f2c86f944125b459ef3af04d296baca857d703efe7c755207 Jun 08 13:53:18.872026 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:18.871960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" event={"ID":"1c090839-8dee-4841-ae2a-c3b17d66ae52","Type":"ContainerStarted","Data":"0d69215c9fd5714339b1391746dbe8bf95ad0eb253df52fa228c2506e9d987f3"} Jun 08 13:53:19.878753 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:19.878718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c86bf48cd-gwj94" event={"ID":"f98d8be0-9c0c-46c3-88f0-275a86284860","Type":"ContainerStarted","Data":"ea831efcce46316f2c86f944125b459ef3af04d296baca857d703efe7c755207"} Jun 08 13:53:20.885894 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.885855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c86bf48cd-gwj94" event={"ID":"f98d8be0-9c0c-46c3-88f0-275a86284860","Type":"ContainerStarted","Data":"24cf0cbc02e864f3baca398b0037e3e0aa3f7f6ce4b98e2e426edd0ad7282cd0"} Jun 08 13:53:20.886315 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.885907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:20.887395 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.887372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" event={"ID":"1c090839-8dee-4841-ae2a-c3b17d66ae52","Type":"ContainerStarted","Data":"ac669cb8eebd58255ee94596d19d907ed9f73d2e8d4a10c5a99a589829074c75"} Jun 08 13:53:20.887511 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.887496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:20.903934 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.903861 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-c86bf48cd-gwj94" podStartSLOduration=2.123791065 podStartE2EDuration="3.903850057s" totalImagesPullingTime="1.780058992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:20.902560775 +0000 UTC m=+572.193077674" watchObservedRunningTime="2026-06-08 13:53:20.903850057 +0000 UTC m=+572.194366954" Jun 08 13:53:20.922624 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:20.922578 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" podStartSLOduration=1.852646998 podStartE2EDuration="2.922562725s" totalImagesPullingTime="1.069915727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:20.921125348 +0000 UTC m=+572.211642256" watchObservedRunningTime="2026-06-08 13:53:20.922562725 +0000 UTC m=+572.213079631" Jun 08 13:53:26.897441 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:26.897410 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-c86bf48cd-gwj94" Jun 08 13:53:28.772429 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:28.772380 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:28.772927 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:28.772685 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" containerID="cri-o://e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d" gracePeriod=30 Jun 08 13:53:30.838550 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.838526 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:30.940786 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.940706 2576 generic.go:356] "Generic (PLEG): container finished" podID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerID="e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d" exitCode=143 Jun 08 13:53:30.940786 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.940748 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:30.940957 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.940788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6a3b3e59-4241-4e56-98c1-4baf9e235526","Type":"ContainerDied","Data":"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d"} Jun 08 13:53:30.940957 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.940843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6a3b3e59-4241-4e56-98c1-4baf9e235526","Type":"ContainerDied","Data":"cd4f1be0a9307970601510a166aca4fd355fd19e5dd588ab7397b8ee12f06d07"} Jun 08 13:53:30.940957 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.940867 2576 scope.go:117] "RemoveContainer" containerID="e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d" Jun 08 13:53:30.949885 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.949867 2576 scope.go:117] "RemoveContainer" containerID="e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d" Jun 08 13:53:30.950165 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:53:30.950144 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d\": container with ID starting with e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d not found: ID does not exist" containerID="e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d" Jun 08 13:53:30.950213 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:30.950176 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d"} err="failed to get container status \"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d\": rpc error: code = NotFound desc = could not find container \"e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d\": container with ID starting with e417a70fbeae661ecbf3c86c7c3433c492e533b18862d8259f3cbf8ad58e4a1d not found: ID does not exist" Jun 08 13:53:31.039794 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.039772 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7gzn\" (UniqueName: \"kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn\") pod \"6a3b3e59-4241-4e56-98c1-4baf9e235526\" (UID: \"6a3b3e59-4241-4e56-98c1-4baf9e235526\") " Jun 08 13:53:31.041908 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.041888 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn" (OuterVolumeSpecName: "kube-api-access-c7gzn") pod "6a3b3e59-4241-4e56-98c1-4baf9e235526" (UID: "6a3b3e59-4241-4e56-98c1-4baf9e235526"). InnerVolumeSpecName "kube-api-access-c7gzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:53:31.140608 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.140581 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7gzn\" (UniqueName: \"kubernetes.io/projected/6a3b3e59-4241-4e56-98c1-4baf9e235526-kube-api-access-c7gzn\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:53:31.259941 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.259887 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:31.263518 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.263498 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:31.284442 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.284420 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:31.284802 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.284789 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" Jun 08 13:53:31.284849 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.284804 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" Jun 08 13:53:31.284886 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.284871 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" containerName="keycloak" Jun 08 13:53:31.289159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.289142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.292098 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.292078 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-77ddp\"" Jun 08 13:53:31.292199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.292164 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:53:31.292199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.292180 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:53:31.292544 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.292522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:53:31.292637 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.292576 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 13:53:31.298523 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.298506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:31.342608 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.342586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/283b2649-559a-4cb3-9aed-13e4dad3e1a9-test-realms\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.342702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.342643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx9bf\" (UniqueName: \"kubernetes.io/projected/283b2649-559a-4cb3-9aed-13e4dad3e1a9-kube-api-access-jx9bf\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.443149 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.443129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx9bf\" (UniqueName: \"kubernetes.io/projected/283b2649-559a-4cb3-9aed-13e4dad3e1a9-kube-api-access-jx9bf\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.443247 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.443195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/283b2649-559a-4cb3-9aed-13e4dad3e1a9-test-realms\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.443764 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.443748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/283b2649-559a-4cb3-9aed-13e4dad3e1a9-test-realms\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.455737 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.455712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx9bf\" (UniqueName: \"kubernetes.io/projected/283b2649-559a-4cb3-9aed-13e4dad3e1a9-kube-api-access-jx9bf\") pod \"maas-keycloak-0\" (UID: \"283b2649-559a-4cb3-9aed-13e4dad3e1a9\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.599587 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.599522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:31.740351 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.740328 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:53:31.742854 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:53:31.742821 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283b2649_559a_4cb3_9aed_13e4dad3e1a9.slice/crio-26c4ee5c0de72a497273c067bbdfc5f43255a15efe548f182873807c08a6711a WatchSource:0}: Error finding container 26c4ee5c0de72a497273c067bbdfc5f43255a15efe548f182873807c08a6711a: Status 404 returned error can't find the container with id 26c4ee5c0de72a497273c067bbdfc5f43255a15efe548f182873807c08a6711a Jun 08 13:53:31.894708 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.894684 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-bcdcn" Jun 08 13:53:31.949437 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:31.949401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"283b2649-559a-4cb3-9aed-13e4dad3e1a9","Type":"ContainerStarted","Data":"26c4ee5c0de72a497273c067bbdfc5f43255a15efe548f182873807c08a6711a"} Jun 08 13:53:32.958350 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:32.958307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"283b2649-559a-4cb3-9aed-13e4dad3e1a9","Type":"ContainerStarted","Data":"32d2a3821a0942f5c0a0ff12cf978289f449abaefc3c18bccf5024bc1761fa94"} Jun 08 13:53:32.979245 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:32.979185 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.630330114 podStartE2EDuration="1.97916475s" totalImagesPullingTime="348.834636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:32.976942398 +0000 UTC m=+584.267459310" watchObservedRunningTime="2026-06-08 13:53:32.97916475 +0000 UTC m=+584.269681648" Jun 08 13:53:33.103366 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:33.103324 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3b3e59-4241-4e56-98c1-4baf9e235526" path="/var/lib/kubelet/pods/6a3b3e59-4241-4e56-98c1-4baf9e235526/volumes" Jun 08 13:53:33.600350 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:33.600306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:33.602030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:33.601971 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:34.600192 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:34.600132 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:35.600764 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:35.600712 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:36.600292 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:36.600233 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:37.600159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:37.600094 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:38.600741 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:38.600679 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:39.600432 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:39.600381 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:40.600717 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:40.600669 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:41.600488 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:41.600446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:41.600717 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:41.600670 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:42.600463 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:42.600406 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:43.600874 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:43.600827 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:44.600108 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:44.600057 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 08 13:53:45.722473 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:45.722419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:45.737792 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:45.737727 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="283b2649-559a-4cb3-9aed-13e4dad3e1a9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:53:55.728963 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:53:55.728921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:06.462830 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.462798 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:54:06.468128 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.468111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.471009 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.470971 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 13:54:06.477013 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.476966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:54:06.489665 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.489642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwdj\" (UniqueName: \"kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.489762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.489708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.489762 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.489750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.590253 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.590230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.590358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.590265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.590358 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.590325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwdj\" (UniqueName: \"kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.590929 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.590912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.592720 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.592700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.598341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.598321 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwdj\" (UniqueName: \"kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj\") pod \"authorino-5957455694-55wnm\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.778095 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.778044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:54:06.908835 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:06.908803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:54:06.913028 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:54:06.913001 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ecad117_988b_40b7_a5a3_52de63c5d8cb.slice/crio-73f8f7d82f42421ede1d2ba53afbee692849afe23e7f6bcde3e03a0c823e4bde WatchSource:0}: Error finding container 73f8f7d82f42421ede1d2ba53afbee692849afe23e7f6bcde3e03a0c823e4bde: Status 404 returned error can't find the container with id 73f8f7d82f42421ede1d2ba53afbee692849afe23e7f6bcde3e03a0c823e4bde Jun 08 13:54:07.164647 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:07.164607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5957455694-55wnm" event={"ID":"1ecad117-988b-40b7-a5a3-52de63c5d8cb","Type":"ContainerStarted","Data":"73f8f7d82f42421ede1d2ba53afbee692849afe23e7f6bcde3e03a0c823e4bde"} Jun 08 13:54:08.170727 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.170695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5957455694-55wnm" event={"ID":"1ecad117-988b-40b7-a5a3-52de63c5d8cb","Type":"ContainerStarted","Data":"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89"} Jun 08 13:54:08.189189 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.189143 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5957455694-55wnm" podStartSLOduration=1.8892452400000002 podStartE2EDuration="2.189128812s" totalImagesPullingTime="299.883572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:08.18764784 +0000 UTC m=+619.478164740" watchObservedRunningTime="2026-06-08 13:54:08.189128812 +0000 UTC m=+619.479645709" Jun 08 13:54:08.219236 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.219208 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:54:08.219393 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.219370 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" podUID="cf8a88ac-7161-4bdb-9795-841fa423dc41" containerName="authorino" containerID="cri-o://b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397" gracePeriod=30 Jun 08 13:54:08.477491 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.477468 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:54:08.505699 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.505670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert\") pod \"cf8a88ac-7161-4bdb-9795-841fa423dc41\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " Jun 08 13:54:08.505807 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.505784 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58zbb\" (UniqueName: \"kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb\") pod \"cf8a88ac-7161-4bdb-9795-841fa423dc41\" (UID: \"cf8a88ac-7161-4bdb-9795-841fa423dc41\") " Jun 08 13:54:08.507834 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.507806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb" (OuterVolumeSpecName: "kube-api-access-58zbb") pod "cf8a88ac-7161-4bdb-9795-841fa423dc41" (UID: "cf8a88ac-7161-4bdb-9795-841fa423dc41"). InnerVolumeSpecName "kube-api-access-58zbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:54:08.515834 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.515813 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cf8a88ac-7161-4bdb-9795-841fa423dc41" (UID: "cf8a88ac-7161-4bdb-9795-841fa423dc41"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:54:08.607211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.607188 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf8a88ac-7161-4bdb-9795-841fa423dc41-tls-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:54:08.607211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:08.607208 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58zbb\" (UniqueName: \"kubernetes.io/projected/cf8a88ac-7161-4bdb-9795-841fa423dc41-kube-api-access-58zbb\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:54:09.175963 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.175927 2576 generic.go:356] "Generic (PLEG): container finished" podID="cf8a88ac-7161-4bdb-9795-841fa423dc41" containerID="b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397" exitCode=0 Jun 08 13:54:09.176341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.175978 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" Jun 08 13:54:09.176341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.176026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" event={"ID":"cf8a88ac-7161-4bdb-9795-841fa423dc41","Type":"ContainerDied","Data":"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397"} Jun 08 13:54:09.176341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.176070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd7fd48d-p6hvc" event={"ID":"cf8a88ac-7161-4bdb-9795-841fa423dc41","Type":"ContainerDied","Data":"9eb4aebf419e75f9630578ef6eef9aab056550dabb0d992c41ba6497c7ac83ff"} Jun 08 13:54:09.176341 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.176090 2576 scope.go:117] "RemoveContainer" containerID="b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397" Jun 08 13:54:09.184767 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.184749 2576 scope.go:117] "RemoveContainer" containerID="b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397" Jun 08 13:54:09.185120 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:54:09.185099 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397\": container with ID starting with b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397 not found: ID does not exist" containerID="b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397" Jun 08 13:54:09.185180 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.185129 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397"} err="failed to get container status \"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397\": rpc error: code = NotFound desc = could not find container \"b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397\": container with ID starting with b4cac22449b885466feff3e9f332783200bce7e4f3b270ebb5d8d11702e90397 not found: ID does not exist" Jun 08 13:54:09.195398 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.195375 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:54:09.199528 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:09.199509 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fcd7fd48d-p6hvc"] Jun 08 13:54:11.100055 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:11.100023 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8a88ac-7161-4bdb-9795-841fa423dc41" path="/var/lib/kubelet/pods/cf8a88ac-7161-4bdb-9795-841fa423dc41/volumes" Jun 08 13:54:23.413966 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.413930 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v"] Jun 08 13:54:23.414614 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.414545 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8a88ac-7161-4bdb-9795-841fa423dc41" containerName="authorino" Jun 08 13:54:23.414614 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.414568 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8a88ac-7161-4bdb-9795-841fa423dc41" containerName="authorino" Jun 08 13:54:23.414770 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.414683 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8a88ac-7161-4bdb-9795-841fa423dc41" containerName="authorino" Jun 08 13:54:23.419483 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.419460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.422336 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.422312 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:54:23.423597 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.423577 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:54:23.423597 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.423589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 13:54:23.423756 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.423600 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2fd7t\"" Jun 08 13:54:23.432803 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.432777 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v"] Jun 08 13:54:23.519124 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44408964-3a23-48b2-8114-a42a8bca8209-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.519223 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d22c\" (UniqueName: \"kubernetes.io/projected/44408964-3a23-48b2-8114-a42a8bca8209-kube-api-access-6d22c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.519223 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.519295 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.519295 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.519295 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.519287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620543 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44408964-3a23-48b2-8114-a42a8bca8209-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d22c\" (UniqueName: \"kubernetes.io/projected/44408964-3a23-48b2-8114-a42a8bca8209-kube-api-access-6d22c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620858 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620858 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.620858 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.620719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.621116 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.621091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.621203 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.621123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.621203 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.621180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.622971 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.622950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44408964-3a23-48b2-8114-a42a8bca8209-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.623143 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.623129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44408964-3a23-48b2-8114-a42a8bca8209-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.629118 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.629102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d22c\" (UniqueName: \"kubernetes.io/projected/44408964-3a23-48b2-8114-a42a8bca8209-kube-api-access-6d22c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v\" (UID: \"44408964-3a23-48b2-8114-a42a8bca8209\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.730659 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.730610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:23.868077 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:23.868052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v"] Jun 08 13:54:23.870241 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:54:23.870209 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44408964_3a23_48b2_8114_a42a8bca8209.slice/crio-db80ff292a4ab1e0c5a2ae580844dda81f56cf71bb2825f2c0af21d965f3f3fb WatchSource:0}: Error finding container db80ff292a4ab1e0c5a2ae580844dda81f56cf71bb2825f2c0af21d965f3f3fb: Status 404 returned error can't find the container with id db80ff292a4ab1e0c5a2ae580844dda81f56cf71bb2825f2c0af21d965f3f3fb Jun 08 13:54:24.248038 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:24.248011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" event={"ID":"44408964-3a23-48b2-8114-a42a8bca8209","Type":"ContainerStarted","Data":"db80ff292a4ab1e0c5a2ae580844dda81f56cf71bb2825f2c0af21d965f3f3fb"} Jun 08 13:54:27.266739 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:27.266699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" event={"ID":"44408964-3a23-48b2-8114-a42a8bca8209","Type":"ContainerStarted","Data":"49c200847cbcb76e0060cb2ea6f89f841c736ac11cf49a89491b9c79f38cd563"} Jun 08 13:54:28.758568 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.758541 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b"] Jun 08 13:54:28.762199 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.762175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.764752 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.764735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 13:54:28.772834 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.772811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b"] Jun 08 13:54:28.871435 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.871435 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2576\" (UniqueName: \"kubernetes.io/projected/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kube-api-access-c2576\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.871675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.871675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.871675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.871675 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.871618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972591 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2576\" (UniqueName: \"kubernetes.io/projected/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kube-api-access-c2576\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.972722 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.972717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.973088 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.973056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.973157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.973107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.973157 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.973132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.975055 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.975034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.975372 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.975352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:28.981215 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:28.981194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2576\" (UniqueName: \"kubernetes.io/projected/dc0c041f-c3b8-4f4c-9ea9-131c309c61f9-kube-api-access-c2576\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jzb9b\" (UID: \"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:29.073089 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:29.073064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:29.217843 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:29.217821 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b"] Jun 08 13:54:29.219439 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:54:29.219416 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0c041f_c3b8_4f4c_9ea9_131c309c61f9.slice/crio-6498ddcfedff354744c8f5f5ae2fd157fb9bda53b3cb9a4f48d9ef3bc2840577 WatchSource:0}: Error finding container 6498ddcfedff354744c8f5f5ae2fd157fb9bda53b3cb9a4f48d9ef3bc2840577: Status 404 returned error can't find the container with id 6498ddcfedff354744c8f5f5ae2fd157fb9bda53b3cb9a4f48d9ef3bc2840577 Jun 08 13:54:29.280614 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:29.280581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" event={"ID":"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9","Type":"ContainerStarted","Data":"6498ddcfedff354744c8f5f5ae2fd157fb9bda53b3cb9a4f48d9ef3bc2840577"} Jun 08 13:54:29.282151 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:29.282126 2576 generic.go:356] "Generic (PLEG): container finished" podID="44408964-3a23-48b2-8114-a42a8bca8209" containerID="49c200847cbcb76e0060cb2ea6f89f841c736ac11cf49a89491b9c79f38cd563" exitCode=0 Jun 08 13:54:29.282261 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:29.282166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" event={"ID":"44408964-3a23-48b2-8114-a42a8bca8209","Type":"ContainerDied","Data":"49c200847cbcb76e0060cb2ea6f89f841c736ac11cf49a89491b9c79f38cd563"} Jun 08 13:54:30.290823 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:30.290784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" event={"ID":"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9","Type":"ContainerStarted","Data":"ff5833d39a51931b1325e0ceecf433ade5da9cecb6064b20da1210d86ff4272b"} Jun 08 13:54:31.300230 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:31.300192 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc0c041f-c3b8-4f4c-9ea9-131c309c61f9" containerID="ff5833d39a51931b1325e0ceecf433ade5da9cecb6064b20da1210d86ff4272b" exitCode=0 Jun 08 13:54:31.300653 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:31.300279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" event={"ID":"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9","Type":"ContainerDied","Data":"ff5833d39a51931b1325e0ceecf433ade5da9cecb6064b20da1210d86ff4272b"} Jun 08 13:54:31.302291 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:31.302272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" event={"ID":"44408964-3a23-48b2-8114-a42a8bca8209","Type":"ContainerStarted","Data":"5939b50909052c5ab0d80cfe6393b2f62ef155f085d7f14ecf2dbb56c3b13b5f"} Jun 08 13:54:31.343537 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:31.343487 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" podStartSLOduration=2.3340132049999998 podStartE2EDuration="8.343474236s" totalImagesPullingTime="4.171066805s" totalInitContainerRuntime="1.838394226s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:31.341460065 +0000 UTC m=+642.631976960" watchObservedRunningTime="2026-06-08 13:54:31.343474236 +0000 UTC m=+642.633991132" Jun 08 13:54:32.308985 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:32.308949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" event={"ID":"dc0c041f-c3b8-4f4c-9ea9-131c309c61f9","Type":"ContainerStarted","Data":"ad8c5d4a036fa8be8994ca621860b6e54c7b956a7f86ec015c923fa9336cff1b"} Jun 08 13:54:32.343854 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:32.343800 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" podStartSLOduration=2.7422839039999998 podStartE2EDuration="4.34378329s" totalImagesPullingTime="263.88845ms" totalInitContainerRuntime="1.337610936s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:32.342365789 +0000 UTC m=+643.632882685" watchObservedRunningTime="2026-06-08 13:54:32.34378329 +0000 UTC m=+643.634300186" Jun 08 13:54:33.730911 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:33.730874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:33.731306 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:33.730940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:33.743322 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:33.743297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:34.329967 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:34.329941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v" Jun 08 13:54:39.073963 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:39.073926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:39.074404 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:39.074025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:39.086212 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:39.086190 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:54:39.355170 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:54:39.355093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jzb9b" Jun 08 13:55:01.786589 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.786552 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m"] Jun 08 13:55:01.791666 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.791645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.796476 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.796453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 13:55:01.809207 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.809178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m"] Jun 08 13:55:01.931702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.931702 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.931949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.931949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsrsq\" (UniqueName: \"kubernetes.io/projected/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kube-api-access-jsrsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.931949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:01.931949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:01.931921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.032791 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.032791 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsrsq\" (UniqueName: \"kubernetes.io/projected/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kube-api-access-jsrsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.032900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033252 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.033218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033310 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.033290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.033374 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.033333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.035159 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.035138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.035484 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.035469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.042648 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.042592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsrsq\" (UniqueName: \"kubernetes.io/projected/e8ff4d08-2e99-40e0-ad1a-da68f3d10d19-kube-api-access-jsrsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m\" (UID: \"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.102438 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.102417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:02.239580 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.239553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m"] Jun 08 13:55:02.241642 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:55:02.241616 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ff4d08_2e99_40e0_ad1a_da68f3d10d19.slice/crio-d76b68e82ef1601c758d927c418f75bdf4787e73eba9c430508fe88a1d8b0745 WatchSource:0}: Error finding container d76b68e82ef1601c758d927c418f75bdf4787e73eba9c430508fe88a1d8b0745: Status 404 returned error can't find the container with id d76b68e82ef1601c758d927c418f75bdf4787e73eba9c430508fe88a1d8b0745 Jun 08 13:55:02.464637 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.464602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" event={"ID":"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19","Type":"ContainerStarted","Data":"8e962bc06fa8740ebc323994b1f5dd02240fdc4d50158aa84eb2bbcd052d2e9c"} Jun 08 13:55:02.464803 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:02.464652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" event={"ID":"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19","Type":"ContainerStarted","Data":"d76b68e82ef1601c758d927c418f75bdf4787e73eba9c430508fe88a1d8b0745"} Jun 08 13:55:04.475295 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:04.475262 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8ff4d08-2e99-40e0-ad1a-da68f3d10d19" containerID="8e962bc06fa8740ebc323994b1f5dd02240fdc4d50158aa84eb2bbcd052d2e9c" exitCode=0 Jun 08 13:55:04.475646 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:04.475338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" event={"ID":"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19","Type":"ContainerDied","Data":"8e962bc06fa8740ebc323994b1f5dd02240fdc4d50158aa84eb2bbcd052d2e9c"} Jun 08 13:55:05.481961 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:05.481929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" event={"ID":"e8ff4d08-2e99-40e0-ad1a-da68f3d10d19","Type":"ContainerStarted","Data":"c2b45c25d6d25da71bb03d8e6aa757ca56eb412ba1c036a20d1dc6278cda5c9b"} Jun 08 13:55:05.514583 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:05.514531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" podStartSLOduration=2.811386411 podStartE2EDuration="4.514515423s" totalImagesPullingTime="372.34299ms" totalInitContainerRuntime="1.330786022s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:55:05.51120455 +0000 UTC m=+676.801721446" watchObservedRunningTime="2026-06-08 13:55:05.514515423 +0000 UTC m=+676.805032320" Jun 08 13:55:09.158888 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.158850 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6"] Jun 08 13:55:09.163270 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.163250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.166384 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.166354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 13:55:09.174232 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.174207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6"] Jun 08 13:55:09.194978 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.194949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.195133 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.195080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.195133 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.195126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.195242 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.195162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9svj\" (UniqueName: \"kubernetes.io/projected/859039fa-71cd-4ecf-91cb-3f24deeca78d-kube-api-access-v9svj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.195242 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.195229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.195309 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.195246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/859039fa-71cd-4ecf-91cb-3f24deeca78d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.295860 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.295837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.295866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/859039fa-71cd-4ecf-91cb-3f24deeca78d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.295910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.295938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.295960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296030 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.296019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9svj\" (UniqueName: \"kubernetes.io/projected/859039fa-71cd-4ecf-91cb-3f24deeca78d-kube-api-access-v9svj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296365 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.296339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296473 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.296355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.296473 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.296424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.298340 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.298310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/859039fa-71cd-4ecf-91cb-3f24deeca78d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.298454 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.298436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/859039fa-71cd-4ecf-91cb-3f24deeca78d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.304980 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.304959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9svj\" (UniqueName: \"kubernetes.io/projected/859039fa-71cd-4ecf-91cb-3f24deeca78d-kube-api-access-v9svj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6\" (UID: \"859039fa-71cd-4ecf-91cb-3f24deeca78d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.475211 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.475149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:09.621890 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:09.621866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6"] Jun 08 13:55:10.509892 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:10.509854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" event={"ID":"859039fa-71cd-4ecf-91cb-3f24deeca78d","Type":"ContainerStarted","Data":"52449ba7c78530aa7479394bb01236489061615b6b416414fcd829a3fee29463"} Jun 08 13:55:10.510467 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:10.509920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" event={"ID":"859039fa-71cd-4ecf-91cb-3f24deeca78d","Type":"ContainerStarted","Data":"eb40615effd9fcfb3c19b328966bb66ca52bec66481262f1f9ebdd7c0c78d2b4"} Jun 08 13:55:11.516311 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:11.516280 2576 generic.go:356] "Generic (PLEG): container finished" podID="859039fa-71cd-4ecf-91cb-3f24deeca78d" containerID="52449ba7c78530aa7479394bb01236489061615b6b416414fcd829a3fee29463" exitCode=0 Jun 08 13:55:11.516667 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:11.516367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" event={"ID":"859039fa-71cd-4ecf-91cb-3f24deeca78d","Type":"ContainerDied","Data":"52449ba7c78530aa7479394bb01236489061615b6b416414fcd829a3fee29463"} Jun 08 13:55:11.516812 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:11.516796 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:55:12.103672 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.103639 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:12.103840 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.103689 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:12.115846 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.115824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:12.523191 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.523156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" event={"ID":"859039fa-71cd-4ecf-91cb-3f24deeca78d","Type":"ContainerStarted","Data":"1e7e36ea1d8d5828bfd588ead734ca0868681a300372cc750471a2428de4da26"} Jun 08 13:55:12.534335 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.534312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m" Jun 08 13:55:12.547297 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:12.547255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" podStartSLOduration=1.84346236 podStartE2EDuration="3.547238555s" totalImagesPullingTime="361.266126ms" totalInitContainerRuntime="1.342510069s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:55:12.546136461 +0000 UTC m=+683.836653377" watchObservedRunningTime="2026-06-08 13:55:12.547238555 +0000 UTC m=+683.837755483" Jun 08 13:55:19.476100 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:19.476059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:19.476558 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:19.476128 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:19.489128 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:19.489099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:55:19.569259 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:55:19.569237 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6" Jun 08 13:56:22.214636 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.214593 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:56:22.215180 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.214811 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5957455694-55wnm" podUID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" containerName="authorino" containerID="cri-o://d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89" gracePeriod=30 Jun 08 13:56:22.464981 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.464927 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:56:22.514418 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.514392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca\") pod \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " Jun 08 13:56:22.514539 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.514459 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qwdj\" (UniqueName: \"kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj\") pod \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " Jun 08 13:56:22.514539 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.514515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert\") pod \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\" (UID: \"1ecad117-988b-40b7-a5a3-52de63c5d8cb\") " Jun 08 13:56:22.516583 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.516557 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj" (OuterVolumeSpecName: "kube-api-access-2qwdj") pod "1ecad117-988b-40b7-a5a3-52de63c5d8cb" (UID: "1ecad117-988b-40b7-a5a3-52de63c5d8cb"). InnerVolumeSpecName "kube-api-access-2qwdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:56:22.519444 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.519423 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "1ecad117-988b-40b7-a5a3-52de63c5d8cb" (UID: "1ecad117-988b-40b7-a5a3-52de63c5d8cb"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:56:22.525105 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.525081 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1ecad117-988b-40b7-a5a3-52de63c5d8cb" (UID: "1ecad117-988b-40b7-a5a3-52de63c5d8cb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:56:22.615670 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.615645 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1ecad117-988b-40b7-a5a3-52de63c5d8cb-oidc-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:56:22.615670 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.615668 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qwdj\" (UniqueName: \"kubernetes.io/projected/1ecad117-988b-40b7-a5a3-52de63c5d8cb-kube-api-access-2qwdj\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:56:22.615802 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.615678 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1ecad117-988b-40b7-a5a3-52de63c5d8cb-tls-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:56:22.882391 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.882333 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" containerID="d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89" exitCode=0 Jun 08 13:56:22.882391 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.882381 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5957455694-55wnm" Jun 08 13:56:22.882517 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.882420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5957455694-55wnm" event={"ID":"1ecad117-988b-40b7-a5a3-52de63c5d8cb","Type":"ContainerDied","Data":"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89"} Jun 08 13:56:22.882517 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.882464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5957455694-55wnm" event={"ID":"1ecad117-988b-40b7-a5a3-52de63c5d8cb","Type":"ContainerDied","Data":"73f8f7d82f42421ede1d2ba53afbee692849afe23e7f6bcde3e03a0c823e4bde"} Jun 08 13:56:22.882517 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.882483 2576 scope.go:117] "RemoveContainer" containerID="d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89" Jun 08 13:56:22.891651 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.891633 2576 scope.go:117] "RemoveContainer" containerID="d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89" Jun 08 13:56:22.892009 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:56:22.891967 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89\": container with ID starting with d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89 not found: ID does not exist" containerID="d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89" Jun 08 13:56:22.892108 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.892022 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89"} err="failed to get container status \"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89\": rpc error: code = NotFound desc = could not find container \"d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89\": container with ID starting with d5b125f8f2810cc620c29a38e2705b5e601313ac7afd66dec868701615c72c89 not found: ID does not exist" Jun 08 13:56:22.923520 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.923498 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:56:22.927978 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:22.927958 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5957455694-55wnm"] Jun 08 13:56:23.106926 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:56:23.106892 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" path="/var/lib/kubelet/pods/1ecad117-988b-40b7-a5a3-52de63c5d8cb/volumes" Jun 08 13:57:52.769822 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:52.769783 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:57:52.770426 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:52.770073 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" podUID="ab462f4d-9a32-4051-8bde-e75b1665e178" containerName="manager" containerID="cri-o://653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e" gracePeriod=30 Jun 08 13:57:53.019268 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.019241 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:57:53.131946 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.131880 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") pod \"ab462f4d-9a32-4051-8bde-e75b1665e178\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " Jun 08 13:57:53.132094 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.131967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfgj9\" (UniqueName: \"kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9\") pod \"ab462f4d-9a32-4051-8bde-e75b1665e178\" (UID: \"ab462f4d-9a32-4051-8bde-e75b1665e178\") " Jun 08 13:57:53.134113 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.134083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ab462f4d-9a32-4051-8bde-e75b1665e178" (UID: "ab462f4d-9a32-4051-8bde-e75b1665e178"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:57:53.134229 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.134130 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9" (OuterVolumeSpecName: "kube-api-access-gfgj9") pod "ab462f4d-9a32-4051-8bde-e75b1665e178" (UID: "ab462f4d-9a32-4051-8bde-e75b1665e178"). InnerVolumeSpecName "kube-api-access-gfgj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:57:53.233383 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.233357 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfgj9\" (UniqueName: \"kubernetes.io/projected/ab462f4d-9a32-4051-8bde-e75b1665e178-kube-api-access-gfgj9\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:57:53.233383 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.233382 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab462f4d-9a32-4051-8bde-e75b1665e178-webhook-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jun 08 13:57:53.332134 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.332104 2576 generic.go:356] "Generic (PLEG): container finished" podID="ab462f4d-9a32-4051-8bde-e75b1665e178" containerID="653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e" exitCode=0 Jun 08 13:57:53.332278 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.332158 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" Jun 08 13:57:53.332278 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.332192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" event={"ID":"ab462f4d-9a32-4051-8bde-e75b1665e178","Type":"ContainerDied","Data":"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e"} Jun 08 13:57:53.332278 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.332246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-cw2nf" event={"ID":"ab462f4d-9a32-4051-8bde-e75b1665e178","Type":"ContainerDied","Data":"799c1fa1410b6e59a442d376ffed0af6d3bb29f05dac7b91ed9c4b709d77fe4f"} Jun 08 13:57:53.332278 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.332269 2576 scope.go:117] "RemoveContainer" containerID="653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e" Jun 08 13:57:53.341949 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.341933 2576 scope.go:117] "RemoveContainer" containerID="653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e" Jun 08 13:57:53.342255 ip-10-0-141-94 kubenswrapper[2576]: E0608 13:57:53.342236 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e\": container with ID starting with 653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e not found: ID does not exist" containerID="653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e" Jun 08 13:57:53.342315 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.342263 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e"} err="failed to get container status \"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e\": rpc error: code = NotFound desc = could not find container \"653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e\": container with ID starting with 653a32a8baa36f94bb0f7188e6e43ba2f096e03e577cdea8db3b9ee7e6dc366e not found: ID does not exist" Jun 08 13:57:53.355561 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.355541 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:57:53.360298 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:53.360267 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-cw2nf"] Jun 08 13:57:54.252756 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.252718 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-5mscw"] Jun 08 13:57:54.253267 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253246 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab462f4d-9a32-4051-8bde-e75b1665e178" containerName="manager" Jun 08 13:57:54.253267 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253269 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab462f4d-9a32-4051-8bde-e75b1665e178" containerName="manager" Jun 08 13:57:54.253393 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253285 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" containerName="authorino" Jun 08 13:57:54.253393 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253292 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" containerName="authorino" Jun 08 13:57:54.253495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253393 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab462f4d-9a32-4051-8bde-e75b1665e178" containerName="manager" Jun 08 13:57:54.253495 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.253407 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ecad117-988b-40b7-a5a3-52de63c5d8cb" containerName="authorino" Jun 08 13:57:54.257827 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.257809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.272032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.272005 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:57:54.272032 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.272010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcqhl\"" Jun 08 13:57:54.272206 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.272014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:57:54.283911 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.283891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-5mscw"] Jun 08 13:57:54.341925 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.341898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqcvt\" (UniqueName: \"kubernetes.io/projected/a99d8dd6-6982-4a01-8035-cdd57533f4c3-kube-api-access-jqcvt\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.342069 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.342053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a99d8dd6-6982-4a01-8035-cdd57533f4c3-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.442535 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.442510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqcvt\" (UniqueName: \"kubernetes.io/projected/a99d8dd6-6982-4a01-8035-cdd57533f4c3-kube-api-access-jqcvt\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.442694 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.442674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a99d8dd6-6982-4a01-8035-cdd57533f4c3-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.445290 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.445267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a99d8dd6-6982-4a01-8035-cdd57533f4c3-webhook-cert\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.476825 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.476797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqcvt\" (UniqueName: \"kubernetes.io/projected/a99d8dd6-6982-4a01-8035-cdd57533f4c3-kube-api-access-jqcvt\") pod \"maas-controller-5cdcd4fcd7-5mscw\" (UID: \"a99d8dd6-6982-4a01-8035-cdd57533f4c3\") " pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.568640 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.568582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:54.713019 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:54.712979 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcd4fcd7-5mscw"] Jun 08 13:57:54.714212 ip-10-0-141-94 kubenswrapper[2576]: W0608 13:57:54.714185 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99d8dd6_6982_4a01_8035_cdd57533f4c3.slice/crio-8a74f5287f73b9c71c07b5043ebef993dbe71e46db27b4b23c98bda52097cca0 WatchSource:0}: Error finding container 8a74f5287f73b9c71c07b5043ebef993dbe71e46db27b4b23c98bda52097cca0: Status 404 returned error can't find the container with id 8a74f5287f73b9c71c07b5043ebef993dbe71e46db27b4b23c98bda52097cca0 Jun 08 13:57:55.100461 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:55.100431 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab462f4d-9a32-4051-8bde-e75b1665e178" path="/var/lib/kubelet/pods/ab462f4d-9a32-4051-8bde-e75b1665e178/volumes" Jun 08 13:57:55.345623 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:55.345593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" event={"ID":"a99d8dd6-6982-4a01-8035-cdd57533f4c3","Type":"ContainerStarted","Data":"788239651abdf4c994eb07b2e29a6ea59e9efedd227d2e1d0a2e10aad99251e1"} Jun 08 13:57:55.345970 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:55.345644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" event={"ID":"a99d8dd6-6982-4a01-8035-cdd57533f4c3","Type":"ContainerStarted","Data":"8a74f5287f73b9c71c07b5043ebef993dbe71e46db27b4b23c98bda52097cca0"} Jun 08 13:57:55.345970 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:55.345708 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 13:57:55.391869 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:57:55.391792 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" podStartSLOduration=0.882637462 podStartE2EDuration="1.391777474s" totalImagesPullingTime="509.140012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:57:55.387559996 +0000 UTC m=+846.678076895" watchObservedRunningTime="2026-06-08 13:57:55.391777474 +0000 UTC m=+846.682294370" Jun 08 13:58:06.356476 ip-10-0-141-94 kubenswrapper[2576]: I0608 13:58:06.356450 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdcd4fcd7-5mscw" Jun 08 14:19:37.066827 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:37.066796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c86bf48cd-gwj94_f98d8be0-9c0c-46c3-88f0-275a86284860/maas-api/0.log" Jun 08 14:19:37.418600 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:37.418570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdcd4fcd7-5mscw_a99d8dd6-6982-4a01-8035-cdd57533f4c3/manager/0.log" Jun 08 14:19:37.920940 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:37.920916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-nbql8_b47fe5c6-3500-4337-a043-e79fa0feeb63/copy-manifests/0.log" Jun 08 14:19:37.938338 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:37.938309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-nbql8_b47fe5c6-3500-4337-a043-e79fa0feeb63/manager/0.log" Jun 08 14:19:40.372136 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:40.372106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qkvmw_9860d5ba-74a9-495e-9bc4-2341b7a17dfb/manager/0.log" Jun 08 14:19:41.127125 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:41.127099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-j4ztk_187d96e2-cd9d-42b9-a979-10703aada256/kube-auth-proxy/0.log" Jun 08 14:19:41.378723 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:41.378646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-bcdcn_1c090839-8dee-4841-ae2a-c3b17d66ae52/payload-pre-processing/0.log" Jun 08 14:19:41.982960 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:41.982932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v_44408964-3a23-48b2-8114-a42a8bca8209/storage-initializer/0.log" Jun 08 14:19:41.992327 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:41.992305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-rcz2v_44408964-3a23-48b2-8114-a42a8bca8209/main/0.log" Jun 08 14:19:42.109120 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.109094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jzb9b_dc0c041f-c3b8-4f4c-9ea9-131c309c61f9/storage-initializer/0.log" Jun 08 14:19:42.122874 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.122854 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jzb9b_dc0c041f-c3b8-4f4c-9ea9-131c309c61f9/main/0.log" Jun 08 14:19:42.362640 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.362483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m_e8ff4d08-2e99-40e0-ad1a-da68f3d10d19/main/0.log" Jun 08 14:19:42.370791 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.370760 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvln5m_e8ff4d08-2e99-40e0-ad1a-da68f3d10d19/storage-initializer/0.log" Jun 08 14:19:42.491705 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.491680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6_859039fa-71cd-4ecf-91cb-3f24deeca78d/storage-initializer/0.log" Jun 08 14:19:42.502854 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:42.502833 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fk2n6_859039fa-71cd-4ecf-91cb-3f24deeca78d/main/0.log" Jun 08 14:19:50.199679 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:50.199653 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x988q_03abd6b8-4546-4b13-9e40-fe59b2cf3b2d/global-pull-secret-syncer/0.log" Jun 08 14:19:50.279164 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:50.279140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cwzbm_c1d82082-df02-4d59-b4b5-e2975a2220dd/konnectivity-agent/0.log" Jun 08 14:19:50.392820 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:50.392797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-94.ec2.internal_de5821b4975da9b864744e1cc737bdf4/haproxy/0.log" Jun 08 14:19:55.933109 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:55.933066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qkvmw_9860d5ba-74a9-495e-9bc4-2341b7a17dfb/manager/0.log" Jun 08 14:19:57.426845 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.426816 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/alertmanager/0.log" Jun 08 14:19:57.451307 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.451279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/config-reloader/0.log" Jun 08 14:19:57.479171 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.479133 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/kube-rbac-proxy-web/0.log" Jun 08 14:19:57.508684 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.508659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/kube-rbac-proxy/0.log" Jun 08 14:19:57.540689 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.540666 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/kube-rbac-proxy-metric/0.log" Jun 08 14:19:57.567963 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.567938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/prom-label-proxy/0.log" Jun 08 14:19:57.594027 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.594009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a75480a8-b81e-4ec8-8e7f-1d946c413ea5/init-config-reloader/0.log" Jun 08 14:19:57.667282 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.667193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d22wr_616d75ac-2d58-46c3-8926-421dfc2c9d23/kube-state-metrics/0.log" Jun 08 14:19:57.690622 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.690601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d22wr_616d75ac-2d58-46c3-8926-421dfc2c9d23/kube-rbac-proxy-main/0.log" Jun 08 14:19:57.716589 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.716568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d22wr_616d75ac-2d58-46c3-8926-421dfc2c9d23/kube-rbac-proxy-self/0.log" Jun 08 14:19:57.747956 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.747936 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c6b8dd46c-v956f_f7f7a444-b7f0-4c6b-8697-de1b96a8fb27/metrics-server/0.log" Jun 08 14:19:57.789168 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:57.789144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-lzmqk_0761857b-0e0d-4d47-aa3d-554937825874/monitoring-plugin/0.log" Jun 08 14:19:58.186965 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.186938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v45nk_9adec353-80fb-423f-a40c-d6f9da14dd53/node-exporter/0.log" Jun 08 14:19:58.222312 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.222225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v45nk_9adec353-80fb-423f-a40c-d6f9da14dd53/kube-rbac-proxy/0.log" Jun 08 14:19:58.248670 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.248646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v45nk_9adec353-80fb-423f-a40c-d6f9da14dd53/init-textfile/0.log" Jun 08 14:19:58.360298 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.360270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tb24j_2c3ee2cd-adfb-41fa-b086-3dd418727ded/kube-rbac-proxy-main/0.log" Jun 08 14:19:58.382450 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.382429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tb24j_2c3ee2cd-adfb-41fa-b086-3dd418727ded/kube-rbac-proxy-self/0.log" Jun 08 14:19:58.406103 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.406075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tb24j_2c3ee2cd-adfb-41fa-b086-3dd418727ded/openshift-state-metrics/0.log" Jun 08 14:19:58.455155 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.455133 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/prometheus/0.log" Jun 08 14:19:58.478745 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.478662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/config-reloader/0.log" Jun 08 14:19:58.502464 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.502429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/thanos-sidecar/0.log" Jun 08 14:19:58.525199 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.525177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/kube-rbac-proxy-web/0.log" Jun 08 14:19:58.548933 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.548909 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/kube-rbac-proxy/0.log" Jun 08 14:19:58.573698 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.573674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/kube-rbac-proxy-thanos/0.log" Jun 08 14:19:58.599187 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.599160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51d80ca5-bb9e-48ad-a338-234e827fe20c/init-config-reloader/0.log" Jun 08 14:19:58.629284 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.629262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-n2k8q_fb6f6fd8-97ad-4343-a344-69b60f72fd68/prometheus-operator/0.log" Jun 08 14:19:58.654480 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.654462 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-n2k8q_fb6f6fd8-97ad-4343-a344-69b60f72fd68/kube-rbac-proxy/0.log" Jun 08 14:19:58.683669 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.683648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-mdg2q_626f7cf8-a468-409f-a01d-8f26eb739133/prometheus-operator-admission-webhook/0.log" Jun 08 14:19:58.718174 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.718146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fbf667699-jdbws_9461b0a2-9ab0-4999-95da-2b8aef5863b0/telemeter-client/0.log" Jun 08 14:19:58.749711 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.749632 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fbf667699-jdbws_9461b0a2-9ab0-4999-95da-2b8aef5863b0/reload/0.log" Jun 08 14:19:58.782543 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.782516 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fbf667699-jdbws_9461b0a2-9ab0-4999-95da-2b8aef5863b0/kube-rbac-proxy/0.log" Jun 08 14:19:58.817487 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.817459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/thanos-query/0.log" Jun 08 14:19:58.841087 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.841061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/kube-rbac-proxy-web/0.log" Jun 08 14:19:58.867925 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.867900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/kube-rbac-proxy/0.log" Jun 08 14:19:58.893789 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.893761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/prom-label-proxy/0.log" Jun 08 14:19:58.919875 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.919850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/kube-rbac-proxy-rules/0.log" Jun 08 14:19:58.944537 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:19:58.944519 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c7bb-g7xw9_fc419787-1b89-40a2-b91f-52d43c844f7a/kube-rbac-proxy-metrics/0.log" Jun 08 14:20:01.733660 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.733626 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9"] Jun 08 14:20:01.737523 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.737506 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.743575 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.743553 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlgqx\"/\"openshift-service-ca.crt\"" Jun 08 14:20:01.743714 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.743563 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlgqx\"/\"kube-root-ca.crt\"" Jun 08 14:20:01.743714 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.743566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dlgqx\"/\"default-dockercfg-kzp2z\"" Jun 08 14:20:01.761057 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.761031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9"] Jun 08 14:20:01.803135 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.803095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-lib-modules\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.803317 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.803171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-sys\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.803317 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.803220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4cmq\" (UniqueName: \"kubernetes.io/projected/6f02f681-13ac-4e52-9a98-d47ac4f7437c-kube-api-access-s4cmq\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.803317 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.803244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-podres\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.803435 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.803347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-proc\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904511 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-sys\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904686 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4cmq\" (UniqueName: \"kubernetes.io/projected/6f02f681-13ac-4e52-9a98-d47ac4f7437c-kube-api-access-s4cmq\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904686 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-podres\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904686 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-sys\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904686 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-proc\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904686 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-proc\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904867 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-lib-modules\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904867 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-podres\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.904867 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.904823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f02f681-13ac-4e52-9a98-d47ac4f7437c-lib-modules\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:01.915138 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:01.915106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4cmq\" (UniqueName: \"kubernetes.io/projected/6f02f681-13ac-4e52-9a98-d47ac4f7437c-kube-api-access-s4cmq\") pod \"perf-node-gather-daemonset-2cqs9\" (UID: \"6f02f681-13ac-4e52-9a98-d47ac4f7437c\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:02.047240 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:02.047154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:02.184626 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:02.184595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9"] Jun 08 14:20:02.187585 ip-10-0-141-94 kubenswrapper[2576]: W0608 14:20:02.187558 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f02f681_13ac_4e52_9a98_d47ac4f7437c.slice/crio-7cbbcee4651a61ac534be7cb890527b37fa9fee391052ed2af96bbcc9fc34231 WatchSource:0}: Error finding container 7cbbcee4651a61ac534be7cb890527b37fa9fee391052ed2af96bbcc9fc34231: Status 404 returned error can't find the container with id 7cbbcee4651a61ac534be7cb890527b37fa9fee391052ed2af96bbcc9fc34231 Jun 08 14:20:03.034548 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.034516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" event={"ID":"6f02f681-13ac-4e52-9a98-d47ac4f7437c","Type":"ContainerStarted","Data":"bc5b0df5d64a8ef5123911ffd127bcc156b37d70a7282b9691135067e5fcbda4"} Jun 08 14:20:03.034548 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.034564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" event={"ID":"6f02f681-13ac-4e52-9a98-d47ac4f7437c","Type":"ContainerStarted","Data":"7cbbcee4651a61ac534be7cb890527b37fa9fee391052ed2af96bbcc9fc34231"} Jun 08 14:20:03.035032 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.034611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:03.054250 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.054197 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" podStartSLOduration=2.054182175 podStartE2EDuration="2.054182175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 14:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 14:20:03.052794409 +0000 UTC m=+2174.343311304" watchObservedRunningTime="2026-06-08 14:20:03.054182175 +0000 UTC m=+2174.344699072" Jun 08 14:20:03.632881 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.632844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bz69m_c8f2879e-5c5f-462b-a76a-f76c18e219fc/dns/0.log" Jun 08 14:20:03.666940 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.666912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bz69m_c8f2879e-5c5f-462b-a76a-f76c18e219fc/kube-rbac-proxy/0.log" Jun 08 14:20:03.874208 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:03.874177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8jnqz_c3645d6b-3f62-47ca-89ed-db4d4620f6f2/dns-node-resolver/0.log" Jun 08 14:20:04.571293 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:04.571260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfvqh_476d4077-1a67-4e55-96a9-f6a2536939f2/node-ca/0.log" Jun 08 14:20:05.738562 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:05.738521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-j4ztk_187d96e2-cd9d-42b9-a979-10703aada256/kube-auth-proxy/0.log" Jun 08 14:20:05.847364 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:05.847330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-bcdcn_1c090839-8dee-4841-ae2a-c3b17d66ae52/payload-pre-processing/0.log" Jun 08 14:20:06.683631 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:06.683594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfxt4_3089123b-2427-4b9c-82cb-9be2a3d3748a/serve-healthcheck-canary/0.log" Jun 08 14:20:07.421856 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:07.421820 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prcvg_ab09ec84-bcce-4ec7-9243-06743a2b454c/kube-rbac-proxy/0.log" Jun 08 14:20:07.447618 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:07.447588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prcvg_ab09ec84-bcce-4ec7-9243-06743a2b454c/exporter/0.log" Jun 08 14:20:07.475633 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:07.475599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prcvg_ab09ec84-bcce-4ec7-9243-06743a2b454c/extractor/0.log" Jun 08 14:20:09.051257 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:09.051227 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-2cqs9" Jun 08 14:20:10.023010 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:10.022969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c86bf48cd-gwj94_f98d8be0-9c0c-46c3-88f0-275a86284860/maas-api/0.log" Jun 08 14:20:10.164637 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:10.164593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdcd4fcd7-5mscw_a99d8dd6-6982-4a01-8035-cdd57533f4c3/manager/0.log" Jun 08 14:20:10.348652 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:10.348551 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-nbql8_b47fe5c6-3500-4337-a043-e79fa0feeb63/manager/0.log" Jun 08 14:20:10.371819 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:10.371793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-nbql8_b47fe5c6-3500-4337-a043-e79fa0feeb63/copy-manifests/0.log" Jun 08 14:20:12.387723 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:12.387684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-687f69c5df-kwgv6_52d3092d-c53b-43b3-87a3-74d99089aae9/manager/0.log" Jun 08 14:20:12.473027 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:12.472960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6bqzw_8800c138-b3ee-42a8-82d2-086e7d49f1d9/openshift-lws-operator/0.log" Jun 08 14:20:15.495090 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:15.495059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-j4ztk_187d96e2-cd9d-42b9-a979-10703aada256/kube-auth-proxy/0.log" Jun 08 14:20:15.585887 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:15.585837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-bcdcn_1c090839-8dee-4841-ae2a-c3b17d66ae52/payload-pre-processing/0.log" Jun 08 14:20:17.168588 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:17.168558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-j4ztk_187d96e2-cd9d-42b9-a979-10703aada256/kube-auth-proxy/0.log" Jun 08 14:20:17.293705 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:17.293673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-bcdcn_1c090839-8dee-4841-ae2a-c3b17d66ae52/payload-pre-processing/0.log" Jun 08 14:20:19.313772 ip-10-0-141-94 kubenswrapper[2576]: I0608 14:20:19.313738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-j4ztk_187d96e2-cd9d-42b9-a979-10703aada256/kube-auth-proxy/0.log"